Sep 11 12:26:47.250310 ip-10-0-143-248 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:26:47.676141 ip-10-0-143-248 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:47.676141 ip-10-0-143-248 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:26:47.676141 ip-10-0-143-248 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:47.676141 ip-10-0-143-248 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:26:47.676141 ip-10-0-143-248 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:47.677344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.677257    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:26:47.683472 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683456    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.683472 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683472    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683476    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683479    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683482    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683488    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683492    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683495    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683504    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683507    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683510    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683513    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683516    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683519    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683523    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683526    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683530    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683532    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683535    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683538    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.683534 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683541    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683544    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683547    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683551    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683554    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683557    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683560    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683562    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683565    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683567    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683570    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683572    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683575    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683577    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683580    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683582    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683585    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683588    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683590    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683593    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.684097 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683595    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683598    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683600    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683610    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683613    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683616    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683618    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683621    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683624    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683626    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683628    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683631    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683633    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683636    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683640    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683643    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683646    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683648    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683651    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683653    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.684582 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683656    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683659    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683661    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683664    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683666    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683669    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683671    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683674    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683676    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683679    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683681    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683684    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683687    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683690    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683693    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683695    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683697    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683700    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683702    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683705    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.685104 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683707    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683710    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683712    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683714    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683717    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683719    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683722    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683725    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683729    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683733    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683737    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683740    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683742    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683745    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683747    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683750    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683752    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683755    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.683759    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.685589 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684466    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684474    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684477    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684480    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684482    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684488    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684492    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684494    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684497    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684500    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684503    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684505    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684508    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684511    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684513    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684516    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684519    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684521    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684524    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684527    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.686102 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684529    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684532    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684535    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684537    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684540    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684542    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684545    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684548    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684550    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684554    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684556    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684558    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684561    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684563    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684566    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684568    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684571    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684574    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684576    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684579    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.686600 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684582    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684585    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684587    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684590    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684593    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684595    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684598    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684600    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684603    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684605    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684608    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684611    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684614    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684617    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684619    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684622    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684624    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684627    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684631    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.687141 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684635    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684638    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684641    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684644    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684647    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684649    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684652    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684654    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684657    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684660    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684664    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684667    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684670    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684674    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684677    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684680    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684682    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684685    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684687    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684690    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.687620 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684692    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684695    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684697    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684700    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684702    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684705    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684708    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684710    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684714    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684717    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684720    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684722    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684725    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684727    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684730    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684732    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684735    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684737    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684740    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.684742    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.688132 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685160    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685167    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685170    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685174    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685177    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685180    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685183    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685186    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685189    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685192    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685195    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685200    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685203    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685206    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685209    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685212    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685215    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685219    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685222    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.688631 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685224    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685227    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685230    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685232    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685235    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685238    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685240    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685243    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685245    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685248    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685250    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685253    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685256    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685258    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685265    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685269    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685273    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685275    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685279    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.689109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685281    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685284    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685287    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685289    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685292    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685294    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685296    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685299    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685301    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685304    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685307    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685309    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685312    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685314    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685317    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685320    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685322    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685325    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685327    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685332    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.689584 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685335    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685338    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685341    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685344    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685348    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685351    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685354    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685356    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685359    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685362    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685364    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685367    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685370    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685373    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685376    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685379    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685381    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685384    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685386    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685389    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.690095 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685392    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685397    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685400    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685402    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685405    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685407    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685410    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685413    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685415    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685418    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685420    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685423    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685426    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685428    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685431    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685433    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685437    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685439    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685442    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685445    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.685447    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.690579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685515    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685560    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685566    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685571    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685576    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685579    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685584    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685588    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685591    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685594    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685598    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685602    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685606    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685609    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685612    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685615    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685618    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685621    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685625    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685628    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685631    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685634    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685638    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685642    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:26:47.691112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685645    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685648    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685652    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685657    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685660    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685663    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685666    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685669    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685673    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685676    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685679    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685682    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685685    2584 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685689    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685693    2584 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685696    2584 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685699    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685702    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685705    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685709    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685712    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685716    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685719    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685722    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685725    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:26:47.691710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685728    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685731    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685734    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685737    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685740    2584 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685744    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685747    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685750    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685753    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685756    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685762    2584 flags.go:64] FLAG: --help="false"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685764    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685768    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685770    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685773    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685777    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685780    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685783    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685786    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685789    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685792    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685796    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685799    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685802    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:26:47.692346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685805    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685808    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685811    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685814    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685817    2584 flags.go:64] FLAG: --lock-file=""
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685820    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685823    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685826    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685832    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685835    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685838    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685841    2584 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685844    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685847    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685850    2584 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685852    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685857    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685860    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685867    2584 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685871    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685874    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685877    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685880    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685882    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685885    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:26:47.692935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685888    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685896    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685899    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685902    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685905    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685908    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685914    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685917    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685920    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685923    2584 flags.go:64] FLAG: --port="10250"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685926    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685929    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0be3e64498284b69e"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685932    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685935    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685937    2584 flags.go:64] FLAG: --register-node="true"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685940    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685944    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685947    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685950    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685953    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685956    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685959    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685962    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685965    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685968    2584 flags.go:64] FLAG: --runonce="false"
Sep 11 12:26:47.693564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685971    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685977    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685980    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685983    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685986    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685989    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685992    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685995    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.685998    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686001    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686004    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686007    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686010    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686014    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686017    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686022    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686039    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686042    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686047    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686050    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686053    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686056    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686059    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686062    2584 flags.go:64] FLAG: --v="2"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686066    2584 flags.go:64] FLAG: --version="false"
Sep 11 12:26:47.694238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686070    2584 flags.go:64] FLAG: --vmodule=""
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686074    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.686077    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686224    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686238    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686243    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686248    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686253    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686257    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686260    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686263    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686266    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686269    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686272    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686274    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686277    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686280    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686283    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686286    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686288    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.694841 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686291    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686295    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686297    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686300    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686303    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686306    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686309    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686311    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686314    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686316    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686319    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686321    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686324    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686327    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686330    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686333    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686696    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686700    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686703    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686706    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.695350 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686708    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686712    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686714    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686717    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686720    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686723    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686726    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686728    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686731    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686734    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686737    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686739    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686742    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686745    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686748    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686750    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686753    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686755    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686758    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.695862 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686762    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686765    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686768    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686771    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686773    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686776    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686779    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686781    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686785    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686788    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686791    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686794    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686796    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686799    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686802    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686804    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686807    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686809    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686812    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686815    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.696401 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686817    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686820    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686823    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686825    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686828    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686830    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686833    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686835    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686838    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686841    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686843    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686847    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686851    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686854    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686857    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686859    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686862    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686865    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686867    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.696893 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686870    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686873    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686878    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.686881    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.687549    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.695225    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.695243    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.696129    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.696137    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696193    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696199    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696202    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696205    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696208    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.697382 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696211    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696215    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696218    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696220    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696225    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696229    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696232    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696235    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696238    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696241    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696244    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696247    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696249    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696252    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696255    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696257    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696260    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696262    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696266    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.697743 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696268    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696271    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696273    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696277    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696280    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696283    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696286    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696289    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696292    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696295    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696297    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696300    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696303    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696307    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696310    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696313    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696316    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696319    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696321    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696324    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.698285 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696327    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696330    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696333    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696335    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696338    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696340    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696343    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696345    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696348    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696351    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696354    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696357    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696360    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696362    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696365    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696368    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696371    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696374    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696377    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696379    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.698772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696382    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696384    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696387    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696389    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696392    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696395    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696397    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696400    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696403    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696406    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696408    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696412    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696414    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696417    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696420    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696422    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696425    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696427    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696430    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696433    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.699265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696435    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696438    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696442    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696445    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696449    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696452    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696455    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696458    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696461    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696464    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696467    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696469    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696472    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696474    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.699775 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696477    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.696482    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696589    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696593    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696596    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696599    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696603    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696606    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696608    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696611    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696614    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696617    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696619    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696622    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696625    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:47.700131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696628    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696630    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696633    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696635    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696638    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696641    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696645    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696648    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696652    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696655    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696658    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696661    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696664    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696667    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696670    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696672    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696675    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696678    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696680    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696683    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:47.700517 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696685    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696688    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696690    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696694    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696698    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696701    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696703    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696706    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696708    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696710    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696713    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696716    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696718    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696721    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696724    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696726    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696729    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696732    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696734    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:47.701059 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696737    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696740    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696743    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696746    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696748    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696751    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696753    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696757    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696761    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696764    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696767    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696770    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696773    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696775    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696778    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696781    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696783    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696786    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696788    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696791    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:47.701601 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696794    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696796    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696799    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696801    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696804    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696806    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696809    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696811    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696814    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696816    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696823    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696826    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696828    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696831    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696834    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696836    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696839    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696842    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696845    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696847    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:47.702178 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696850    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696853    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696856    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696858    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696861    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696864    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:47.696866    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.696871    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.696968    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.701136    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.702292    2584 server.go:1019] "Starting client certificate rotation"
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.702414    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:26:47.702818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.702466    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:26:47.705086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.705068    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:26:47.710655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.710632    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:26:47.718112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.718047    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:26:47.721448 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.721432    2584 log.go:25] "Validated CRI v1 image API"
Sep 11 12:26:47.722347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.722326    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:26:47.729443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.729425    2584 fs.go:135] Filesystem UUIDs: map[0277b389-abc9-4c64-81df-0a49a2068d5d:/dev/nvme0n1p4 5c2f2fe8-007d-436c-8c4b-c993e0b6e7b5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 11 12:26:47.729513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.729442    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:26:47.734621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.734505    2584 manager.go:216] Machine: {Timestamp:2026-09-11 12:26:47.733099279 +0000 UTC m=+0.376991928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087515 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260a4dff06583feaac3d476d28f6a6 SystemUUID:ec260a4d-ff06-583f-eaac-3d476d28f6a6 BootID:e01af4d7-58ad-44ff-8ab6-d988f821684a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:33:3d:3f:48:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:33:3d:3f:48:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:c8:de:83:d7:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:26:47.734621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.734611    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:26:47.734743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.734695    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:26:47.737394 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.737379    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:26:47.738187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.738163    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:26:47.738336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.738191    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:26:47.739805 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.739793    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:26:47.739805 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.739806    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:26:47.739884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.739814    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:26:47.740682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.740672    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:26:47.741980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.741971    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:26:47.746625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746614    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:26:47.746736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746727    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:26:47.746771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746757    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:26:47.746771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746767    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:26:47.746822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746782    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:26:47.746822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746793    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:26:47.746822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.746802    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:26:47.747188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.747176    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:26:47.747238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.747194    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:26:47.750302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.750288    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:26:47.754962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.754945    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:26:47.755038 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.754977    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:26:47.757763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757748    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757767    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757774    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757780    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757788    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757793    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757806    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757811    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757818    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757824    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757832    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:26:47.757833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.757838    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:26:47.758734 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.758716    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:26:47.758788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.758733    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:26:47.758788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.758751    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:26:47.758865 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.758719    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:26:47.760445 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.760431    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fmh7"
Sep 11 12:26:47.762549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.762537    2584 server.go:1268] "Started kubelet"
Sep 11 12:26:47.762629 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.762601    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:26:47.762724 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.762650    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:26:47.762816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.762741    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:26:47.763280 ip-10-0-143-248 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:26:47.764889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.764881    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:26:47.766571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.766550    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:26:47.768975 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.768956    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4fmh7"
Sep 11 12:26:47.769124 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.769102    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:26:47.772111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.772096    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:26:47.773240 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.772128    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-248.ec2.internal.18d443e627d17bac  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-248.ec2.internal,UID:ip-10-0-143-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-248.ec2.internal,},FirstTimestamp:2026-09-11 12:26:47.762508716 +0000 UTC m=+0.406401429,LastTimestamp:2026-09-11 12:26:47.762508716 +0000 UTC m=+0.406401429,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-248.ec2.internal,}"
Sep 11 12:26:47.774172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.774158    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:26:47.774877 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.774857    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:26:47.775109 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.775060    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:47.775667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775649    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:26:47.775667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775668    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:26:47.775818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775648    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:26:47.775818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775785    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:26:47.775818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775796    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:26:47.775818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775790    2584 factory.go:55] Registering systemd factory
Sep 11 12:26:47.775818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.775814    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:26:47.776049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776021    2584 factory.go:153] Registering CRI-O factory
Sep 11 12:26:47.776092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776055    2584 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:26:47.776121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776106    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:26:47.776152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776128    2584 factory.go:103] Registering Raw factory
Sep 11 12:26:47.776152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776142    2584 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:26:47.776610 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.776586    2584 manager.go:349] Starting recovery of all containers
Sep 11 12:26:47.777359 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.777333    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:26:47.777486 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.777460    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:26:47.784522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.784398    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:26:47.787241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.787216    2584 manager.go:354] Recovery completed
Sep 11 12:26:47.793482 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.793469    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.795437 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.795418    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.795503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.795451    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.795503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.795464    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.796089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796073    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:26:47.796089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796089    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:26:47.796220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796109    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:26:47.796220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796079    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.796779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796767    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.796830 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796789    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.796830 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.796801    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.798579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.798568    2584 policy_none.go:49] "None policy: Start"
Sep 11 12:26:47.798614 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.798583    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:26:47.798614 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.798592    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:26:47.800602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.800590    2584 policy_none.go:47] "Start"
Sep 11 12:26:47.830768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.830750    2584 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.830796    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.830810    2584 server.go:87] "Starting device plugin registration server"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.831121    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.831132    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.831257    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.831324    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.831332    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.833307    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:26:47.850480 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.833358    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:47.870315 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.870292    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:26:47.870408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.870354    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:26:47.870408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.870378    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:26:47.870493 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.870459    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 12:26:47.872300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.872284    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:47.932090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.931991    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.932899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.932882    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.932971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.932912    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.932971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.932923    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.932971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.932943    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.940861 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.940842    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.940861 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.940862    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-248.ec2.internal\": node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:47.957705 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.957687    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:47.970709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.970688    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"]
Sep 11 12:26:47.970767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.970751    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.971548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.971533    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.971620 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.971562    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.971620 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.971576    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.973546 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.973534    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.973670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.973657    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.973705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.973685    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.974307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974294    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.974380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974325    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.974380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974336    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.974460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974325    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.974489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974480    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.974520 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.974491    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.976399 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.976379    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.976473 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.976414    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:47.979266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.979251    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:47.979337 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.979283    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:47.979337 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:47.979296    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:47.990529 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.990506    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-248.ec2.internal\" not found" node="ip-10-0-143-248.ec2.internal"
Sep 11 12:26:47.995581 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:47.995567    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-248.ec2.internal\" not found" node="ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.058221 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.058199    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.076377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.076358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.076441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.076381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.076441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.076397    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/687ab058f6ce8f763e9516f8b1ddbd13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"687ab058f6ce8f763e9516f8b1ddbd13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.159008 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.158979    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.177283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/687ab058f6ce8f763e9516f8b1ddbd13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"687ab058f6ce8f763e9516f8b1ddbd13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.177348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.177348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.177348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177333    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/687ab058f6ce8f763e9516f8b1ddbd13-config\") pod \"kube-apiserver-proxy-ip-10-0-143-248.ec2.internal\" (UID: \"687ab058f6ce8f763e9516f8b1ddbd13\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.177348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.177478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.177343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90c2b75851fd862a0e695ddba4b5ed7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal\" (UID: \"90c2b75851fd862a0e695ddba4b5ed7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.259710 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.259648    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.294088 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.294068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.298930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.298715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.360096 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.360062    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.466609 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.466584    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.570418 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.570340    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.672864 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.672829    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.702127 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.702089    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:26:48.702572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.702242    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:26:48.760535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.760510    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:48.773130 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:48.773105    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-248.ec2.internal\" not found"
Sep 11 12:26:48.775489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.775464    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:21:48 +0000 UTC" deadline="2028-06-16 08:34:32.388918546 +0000 UTC"
Sep 11 12:26:48.775554 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.775489    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15452h7m43.61343213s"
Sep 11 12:26:48.835408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.835343    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:48.875262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.875235    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.888898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.888875    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:26:48.890423 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.890403    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"
Sep 11 12:26:48.900859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.900840    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:26:48.920188 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:48.920153    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c2b75851fd862a0e695ddba4b5ed7c.slice/crio-d92e4ba17e561a5a3b6f9ae5aa94b00a786a41cb084dba39305383787e6b3e80 WatchSource:0}: Error finding container d92e4ba17e561a5a3b6f9ae5aa94b00a786a41cb084dba39305383787e6b3e80: Status 404 returned error can't find the container with id d92e4ba17e561a5a3b6f9ae5aa94b00a786a41cb084dba39305383787e6b3e80
Sep 11 12:26:48.920496 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:48.920470    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687ab058f6ce8f763e9516f8b1ddbd13.slice/crio-834d28a58300b5e21901c02658bc8510a299bef25b2a26624ecad7442587872b WatchSource:0}: Error finding container 834d28a58300b5e21901c02658bc8510a299bef25b2a26624ecad7442587872b: Status 404 returned error can't find the container with id 834d28a58300b5e21901c02658bc8510a299bef25b2a26624ecad7442587872b
Sep 11 12:26:48.924904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:48.924877    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:26:49.054593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.054566    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:49.714125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.714088    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:49.748940 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.748895    2584 apiserver.go:52] "Watching apiserver"
Sep 11 12:26:49.764309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.764279    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:26:49.765674 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.765640    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-fjlxr","openshift-multus/multus-25h7k","openshift-multus/network-metrics-daemon-d2986","openshift-ovn-kubernetes/ovnkube-node-4c2f5","kube-system/konnectivity-agent-hr7qd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb","openshift-dns/node-resolver-cq4jq","openshift-image-registry/node-ca-989g7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal","openshift-multus/multus-additional-cni-plugins-rvqw4","openshift-network-diagnostics/network-check-target-rjjj9","openshift-network-operator/iptables-alerter-v7hs6","kube-system/global-pull-secret-syncer-drh5s","kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal"]
Sep 11 12:26:49.768389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.768364    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.771241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.770742    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.771241 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.770816    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:49.771738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.771714    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.772238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.772036    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgwhk\""
Sep 11 12:26:49.772238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.772050    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.773853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.773830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.773952 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.773932    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:49.774412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.774390    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:26:49.776912 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.776890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.780520 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780234    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:26:49.780520 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780301    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl7z4\""
Sep 11 12:26:49.780520 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780342    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:26:49.780727 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780522    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.780727 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780596    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.780727 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780610    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:26:49.780727 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780631    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.780921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.780884    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:26:49.782741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.782721    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.783896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.783867    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:26:49.784293 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.784259    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27wvb\""
Sep 11 12:26:49.784905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.784857    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:26:49.785351 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.785328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.785965 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.785945    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.786164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786126    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k7ftm\""
Sep 11 12:26:49.786164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786154    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.786307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786273    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:26:49.786925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a582d3-2efd-40bb-bbee-42177f734634-tmp-dir\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.786925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-dbus\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.786925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.786925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.786925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-env-overrides\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786949    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzcwt\" (UniqueName: \"kubernetes.io/projected/74cc5456-d9bd-4776-926b-185a4ecc6b8a-kube-api-access-qzcwt\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.786985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787011    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-ovn\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-script-lib\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787161    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01a582d3-2efd-40bb-bbee-42177f734634-hosts-file\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787185    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24f01518-eb66-4676-ae1f-255e1732bb07-konnectivity-ca\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.787266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-systemd-units\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-slash\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787322    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-log-socket\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-kubelet-config\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wptv\" (UniqueName: \"kubernetes.io/projected/bda0ade2-4e30-4ccc-b3b3-53623c963601-kube-api-access-5wptv\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-systemd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-etc-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787561    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-bin\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-netd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24f01518-eb66-4676-ae1f-255e1732bb07-agent-certs\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-netns\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-var-lib-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.787756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-config\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.788637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5874\" (UniqueName: \"kubernetes.io/projected/01a582d3-2efd-40bb-bbee-42177f734634-kube-api-access-j5874\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.788637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-kubelet\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.788637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.787832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-node-log\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.788637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.788521    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.792024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.791769    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.792024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.791985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.792220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.792182    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nj78d\""
Sep 11 12:26:49.793635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.792507    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:26:49.793635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.792725    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.793635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.793254    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.793635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.793479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mdl68\""
Sep 11 12:26:49.793635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.793541    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.794956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.794889    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.796494 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.796460    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.796709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.796690    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:26:49.796962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.796941    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:26:49.798467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.798439    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:49.798579 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.798520    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:26:49.798878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.798859    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.799109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.799089    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:26:49.799198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.799186    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:26:49.801009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.799818    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.801009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.799887    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zj2q\""
Sep 11 12:26:49.801009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.800099    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:26:49.801009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.800396    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r8mmf\""
Sep 11 12:26:49.803283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.803068    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9dfj\""
Sep 11 12:26:49.803283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.803086    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:26:49.803283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.803271    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:26:49.803714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.803692    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:26:49.817466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.817442    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqf4q"
Sep 11 12:26:49.827639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.827390    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqf4q"
Sep 11 12:26:49.876632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.876577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"90c2b75851fd862a0e695ddba4b5ed7c","Type":"ContainerStarted","Data":"d92e4ba17e561a5a3b6f9ae5aa94b00a786a41cb084dba39305383787e6b3e80"}
Sep 11 12:26:49.876853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.876833    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:26:49.878422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.878373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" event={"ID":"687ab058f6ce8f763e9516f8b1ddbd13","Type":"ContainerStarted","Data":"834d28a58300b5e21901c02658bc8510a299bef25b2a26624ecad7442587872b"}
Sep 11 12:26:49.888697 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-multus-certs\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01a582d3-2efd-40bb-bbee-42177f734634-hosts-file\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24f01518-eb66-4676-ae1f-255e1732bb07-konnectivity-ca\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-registration-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-systemd-units\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.888833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-slash\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-log-socket\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-lib-modules\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888902    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-k8s-cni-cncf-io\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qdzw\" (UniqueName: \"kubernetes.io/projected/ff43cf92-ce90-4553-a63a-6f814adf91e4-kube-api-access-2qdzw\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-kubelet-config\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.888997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wptv\" (UniqueName: \"kubernetes.io/projected/bda0ade2-4e30-4ccc-b3b3-53623c963601-kube-api-access-5wptv\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-systemd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-etc-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889092    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889110    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-device-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-systemd\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889146    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vd9\" (UniqueName: \"kubernetes.io/projected/a5f79f29-400f-49f9-b359-0d77dc97edd9-kube-api-access-59vd9\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.889184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eca52884-844e-44ac-bf10-ed9ed85ecece-iptables-alerter-script\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-config\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-kubelet\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-hostroot\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-system-cni-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58km\" (UniqueName: \"kubernetes.io/projected/eca52884-844e-44ac-bf10-ed9ed85ecece-kube-api-access-m58km\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-kubelet\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-node-log\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889391    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01a582d3-2efd-40bb-bbee-42177f734634-hosts-file\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk9q4\" (UniqueName: \"kubernetes.io/projected/46166e53-54cb-485d-a443-6f099b77498f-kube-api-access-dk9q4\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889459    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-dbus\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-env-overrides\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889563    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-script-lib\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.889906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889607    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-systemd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-host\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889653    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/46166e53-54cb-485d-a443-6f099b77498f-serviceca\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889656    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-kubelet-config\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-system-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-bin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889715    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-node-log\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889768    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-etc-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5a4b25-7707-43ea-aaef-50afeb3fb290-dbus\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-kubelet\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-daemon-config\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889880    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-etc-kubernetes\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.889968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-log-socket\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.889986    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890034    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-systemd-units\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-slash\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.890870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890053    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24f01518-eb66-4676-ae1f-255e1732bb07-konnectivity-ca\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890102    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-var-lib-kubelet\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.890120    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.890148    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:50.390123582 +0000 UTC m=+3.034016245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-tmp\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:49.890261    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:50.390240924 +0000 UTC m=+3.034133562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-modprobe-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-sys\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-socket-dir-parent\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-run\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-config\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-cni-binary-copy\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-bin\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-netd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.891794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24f01518-eb66-4676-ae1f-255e1732bb07-agent-certs\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890532    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-netd\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-netns\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-cni-bin\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-var-lib-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46166e53-54cb-485d-a443-6f099b77498f-host\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-conf\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-netns\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5874\" (UniqueName: \"kubernetes.io/projected/01a582d3-2efd-40bb-bbee-42177f734634-kube-api-access-j5874\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-sys-fs\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysconfig\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvjxb\" (UniqueName: \"kubernetes.io/projected/90374b8d-533a-41cc-b34a-512cc5f2ea79-kube-api-access-kvjxb\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-cnibin\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890936    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a582d3-2efd-40bb-bbee-42177f734634-tmp-dir\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.892623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.890992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891021    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzcwt\" (UniqueName: \"kubernetes.io/projected/74cc5456-d9bd-4776-926b-185a4ecc6b8a-kube-api-access-qzcwt\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891090    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovnkube-script-lib\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-tuned\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-multus\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891131    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-netns\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eca52884-844e-44ac-bf10-ed9ed85ecece-host-slash\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-var-lib-openvswitch\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-ovn\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-socket-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891563    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wk5\" (UniqueName: \"kubernetes.io/projected/771bf1c8-5437-484c-bbf5-633e05405a65-kube-api-access-n7wk5\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-kubernetes\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891611    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-cnibin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-conf-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-run-ovn\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.893544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891793    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74cc5456-d9bd-4776-926b-185a4ecc6b8a-env-overrides\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.894166 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74cc5456-d9bd-4776-926b-185a4ecc6b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.894166 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.891910    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a582d3-2efd-40bb-bbee-42177f734634-tmp-dir\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.895843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.895788    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24f01518-eb66-4676-ae1f-255e1732bb07-agent-certs\") pod \"konnectivity-agent-hr7qd\" (UID: \"24f01518-eb66-4676-ae1f-255e1732bb07\") " pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:49.895949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.895865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74cc5456-d9bd-4776-926b-185a4ecc6b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.906556 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.906527    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5874\" (UniqueName: \"kubernetes.io/projected/01a582d3-2efd-40bb-bbee-42177f734634-kube-api-access-j5874\") pod \"node-resolver-cq4jq\" (UID: \"01a582d3-2efd-40bb-bbee-42177f734634\") " pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:49.907430 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.907385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wptv\" (UniqueName: \"kubernetes.io/projected/bda0ade2-4e30-4ccc-b3b3-53623c963601-kube-api-access-5wptv\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:49.909237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.909189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzcwt\" (UniqueName: \"kubernetes.io/projected/74cc5456-d9bd-4776-926b-185a4ecc6b8a-kube-api-access-qzcwt\") pod \"ovnkube-node-4c2f5\" (UID: \"74cc5456-d9bd-4776-926b-185a4ecc6b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993332    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eca52884-844e-44ac-bf10-ed9ed85ecece-iptables-alerter-script\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993380    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-kubelet\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-hostroot\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-system-cni-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58km\" (UniqueName: \"kubernetes.io/projected/eca52884-844e-44ac-bf10-ed9ed85ecece-kube-api-access-m58km\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk9q4\" (UniqueName: \"kubernetes.io/projected/46166e53-54cb-485d-a443-6f099b77498f-kube-api-access-dk9q4\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-system-cni-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-kubelet\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-host\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-host\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994027    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/46166e53-54cb-485d-a443-6f099b77498f-serviceca\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994056    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-system-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.994833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-bin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-daemon-config\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-etc-kubernetes\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eca52884-844e-44ac-bf10-ed9ed85ecece-iptables-alerter-script\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-var-lib-kubelet\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-tmp\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994580    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-modprobe-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.993737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-hostroot\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-sys\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-socket-dir-parent\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-run\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994847    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-cni-binary-copy\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994883    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46166e53-54cb-485d-a443-6f099b77498f-host\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994932    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-sys\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.994959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-conf\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.995789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-conf\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995215    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-run\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-etc-kubernetes\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-var-lib-kubelet\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995333    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysctl-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-system-cni-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46166e53-54cb-485d-a443-6f099b77498f-host\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995466    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-modprobe-d\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995462    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-netns\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995500    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995505    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-netns\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-sys-fs\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysconfig\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvjxb\" (UniqueName: \"kubernetes.io/projected/90374b8d-533a-41cc-b34a-512cc5f2ea79-kube-api-access-kvjxb\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995587    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-cnibin\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995608    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.996777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995631    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-tuned\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-multus\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eca52884-844e-44ac-bf10-ed9ed85ecece-host-slash\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-socket-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wk5\" (UniqueName: \"kubernetes.io/projected/771bf1c8-5437-484c-bbf5-633e05405a65-kube-api-access-n7wk5\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-kubernetes\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-cnibin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-conf-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-multus-certs\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995960    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-registration-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-lib-modules\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-k8s-cni-cncf-io\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qdzw\" (UniqueName: \"kubernetes.io/projected/ff43cf92-ce90-4553-a63a-6f814adf91e4-kube-api-access-2qdzw\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-device-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-sys-fs\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.997741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-systemd\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vd9\" (UniqueName: \"kubernetes.io/projected/a5f79f29-400f-49f9-b359-0d77dc97edd9-kube-api-access-59vd9\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-cni-binary-copy\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996341    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996278    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-systemd\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996365    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eca52884-844e-44ac-bf10-ed9ed85ecece-host-slash\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-multus\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.995827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-socket-dir-parent\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-kubernetes\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-multus-certs\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996815    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-daemon-config\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996846    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-multus-conf-dir\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.996932    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-run-k8s-cni-cncf-io\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-device-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-registration-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.998686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-lib-modules\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5f79f29-400f-49f9-b359-0d77dc97edd9-cnibin\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-host-var-lib-cni-bin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997422    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/771bf1c8-5437-484c-bbf5-633e05405a65-socket-dir\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-sysconfig\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997559    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff43cf92-ce90-4553-a63a-6f814adf91e4-cnibin\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.997758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5f79f29-400f-49f9-b359-0d77dc97edd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.998174    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/46166e53-54cb-485d-a443-6f099b77498f-serviceca\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:49.999583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:49.999050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-tmp\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:50.000830 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.000758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90374b8d-533a-41cc-b34a-512cc5f2ea79-etc-tuned\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:50.002578 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.002555    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:50.002680 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.002585    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:50.002680 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.002601    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:50.002809 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.002720    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:50.502698087 +0000 UTC m=+3.146590736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:50.003670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.003644    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58km\" (UniqueName: \"kubernetes.io/projected/eca52884-844e-44ac-bf10-ed9ed85ecece-kube-api-access-m58km\") pod \"iptables-alerter-v7hs6\" (UID: \"eca52884-844e-44ac-bf10-ed9ed85ecece\") " pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:50.005234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.005208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk9q4\" (UniqueName: \"kubernetes.io/projected/46166e53-54cb-485d-a443-6f099b77498f-kube-api-access-dk9q4\") pod \"node-ca-989g7\" (UID: \"46166e53-54cb-485d-a443-6f099b77498f\") " pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:50.006288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.006245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wk5\" (UniqueName: \"kubernetes.io/projected/771bf1c8-5437-484c-bbf5-633e05405a65-kube-api-access-n7wk5\") pod \"aws-ebs-csi-driver-node-8dspb\" (UID: \"771bf1c8-5437-484c-bbf5-633e05405a65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:50.006525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.006481    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvjxb\" (UniqueName: \"kubernetes.io/projected/90374b8d-533a-41cc-b34a-512cc5f2ea79-kube-api-access-kvjxb\") pod \"tuned-fjlxr\" (UID: \"90374b8d-533a-41cc-b34a-512cc5f2ea79\") " pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:50.006992 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.006970    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qdzw\" (UniqueName: \"kubernetes.io/projected/ff43cf92-ce90-4553-a63a-6f814adf91e4-kube-api-access-2qdzw\") pod \"multus-25h7k\" (UID: \"ff43cf92-ce90-4553-a63a-6f814adf91e4\") " pod="openshift-multus/multus-25h7k"
Sep 11 12:26:50.007062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.006996    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vd9\" (UniqueName: \"kubernetes.io/projected/a5f79f29-400f-49f9-b359-0d77dc97edd9-kube-api-access-59vd9\") pod \"multus-additional-cni-plugins-rvqw4\" (UID: \"a5f79f29-400f-49f9-b359-0d77dc97edd9\") " pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:50.082350 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.082304    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cq4jq"
Sep 11 12:26:50.093693 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.093666    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:26:50.109881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.109854    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:26:50.115911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.115890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb"
Sep 11 12:26:50.123660 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.123633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-989g7"
Sep 11 12:26:50.132643 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.132619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fjlxr"
Sep 11 12:26:50.143716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.143689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25h7k"
Sep 11 12:26:50.150803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.150777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvqw4"
Sep 11 12:26:50.158728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.158708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v7hs6"
Sep 11 12:26:50.399291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.399209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:50.399291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.399266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:50.399526 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.399368    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:50.399526 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.399369    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:50.399526 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.399432    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:51.399417493 +0000 UTC m=+4.043310145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:50.399526 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.399447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:51.399440978 +0000 UTC m=+4.043333615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:50.601264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.601230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:50.601443 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.601399    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:50.601443 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.601417    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:50.601443 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.601427    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:50.601591 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:50.601484    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:51.601470705 +0000 UTC m=+4.245363356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:50.830866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.830726    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:21:50 +0000 UTC" deadline="2028-04-09 02:38:43.738632521 +0000 UTC"
Sep 11 12:26:50.830866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:50.830781    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13814h11m52.907856842s"
Sep 11 12:26:51.165011 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.164979    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771bf1c8_5437_484c_bbf5_633e05405a65.slice/crio-6144ca52e0f017e0d1cbcdc1040813d2602cb5fed0bfc1e10f1592618a2e0123 WatchSource:0}: Error finding container 6144ca52e0f017e0d1cbcdc1040813d2602cb5fed0bfc1e10f1592618a2e0123: Status 404 returned error can't find the container with id 6144ca52e0f017e0d1cbcdc1040813d2602cb5fed0bfc1e10f1592618a2e0123
Sep 11 12:26:51.166759 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.166663    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca52884_844e_44ac_bf10_ed9ed85ecece.slice/crio-26ace768a5b344c6390f5c1a71c1287a5096296df7f96dc6529d6bf9918ef1c3 WatchSource:0}: Error finding container 26ace768a5b344c6390f5c1a71c1287a5096296df7f96dc6529d6bf9918ef1c3: Status 404 returned error can't find the container with id 26ace768a5b344c6390f5c1a71c1287a5096296df7f96dc6529d6bf9918ef1c3
Sep 11 12:26:51.167932 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.167900    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74cc5456_d9bd_4776_926b_185a4ecc6b8a.slice/crio-843e59d6b3f4d88c3b58d0c01afce0e87d471cec19c30991aef3ee58d8233bb3 WatchSource:0}: Error finding container 843e59d6b3f4d88c3b58d0c01afce0e87d471cec19c30991aef3ee58d8233bb3: Status 404 returned error can't find the container with id 843e59d6b3f4d88c3b58d0c01afce0e87d471cec19c30991aef3ee58d8233bb3
Sep 11 12:26:51.173198 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.172965    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff43cf92_ce90_4553_a63a_6f814adf91e4.slice/crio-6bb83fd3794da536d730ff8fedf121c62a9c7bac30ccc15aa247e6ca070d609a WatchSource:0}: Error finding container 6bb83fd3794da536d730ff8fedf121c62a9c7bac30ccc15aa247e6ca070d609a: Status 404 returned error can't find the container with id 6bb83fd3794da536d730ff8fedf121c62a9c7bac30ccc15aa247e6ca070d609a
Sep 11 12:26:51.176174 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.176125    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46166e53_54cb_485d_a443_6f099b77498f.slice/crio-265bcbe1ebf8e3a3b4d1ba14b4db9efa82431742b8ef603c01edb945108ccdef WatchSource:0}: Error finding container 265bcbe1ebf8e3a3b4d1ba14b4db9efa82431742b8ef603c01edb945108ccdef: Status 404 returned error can't find the container with id 265bcbe1ebf8e3a3b4d1ba14b4db9efa82431742b8ef603c01edb945108ccdef
Sep 11 12:26:51.176968 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.176919    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a582d3_2efd_40bb_bbee_42177f734634.slice/crio-a019905b5c0197f3c5442f4fe4c6b058a3241fe833fe99d8fb9b9446474ff649 WatchSource:0}: Error finding container a019905b5c0197f3c5442f4fe4c6b058a3241fe833fe99d8fb9b9446474ff649: Status 404 returned error can't find the container with id a019905b5c0197f3c5442f4fe4c6b058a3241fe833fe99d8fb9b9446474ff649
Sep 11 12:26:51.177925 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:26:51.177889    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90374b8d_533a_41cc_b34a_512cc5f2ea79.slice/crio-094e041bbcb37ba159f748b6646ca5fa9d3d10f6f4fc9b46dd8d2605f11a633b WatchSource:0}: Error finding container 094e041bbcb37ba159f748b6646ca5fa9d3d10f6f4fc9b46dd8d2605f11a633b: Status 404 returned error can't find the container with id 094e041bbcb37ba159f748b6646ca5fa9d3d10f6f4fc9b46dd8d2605f11a633b
Sep 11 12:26:51.409356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.409322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:51.409514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.409377    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:51.409514 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.409480    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:51.409625 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.409537    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:53.40951958 +0000 UTC m=+6.053412219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:51.409625 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.409480    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:51.409625 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.409578    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:53.409569882 +0000 UTC m=+6.053462522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:51.611378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.611342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:51.611550 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.611528    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:51.611550 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.611547    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:51.611696 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.611563    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:51.611696 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.611660    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:53.611637344 +0000 UTC m=+6.255529998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:51.831680 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.831564    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:21:50 +0000 UTC" deadline="2028-03-04 19:36:42.071354918 +0000 UTC"
Sep 11 12:26:51.831680 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.831603    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12967h9m50.239756344s"
Sep 11 12:26:51.871978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.871234    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:51.871978 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.871369    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:26:51.871978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.871822    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:51.871978 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.871923    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:51.872579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.872394    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:51.872579 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:51.872509    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:51.891584 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.891466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerStarted","Data":"7d68f2ce4e136bcdec5232bf7e444bace06410c1d0dde79a27a23b4e7c8b98c1"}
Sep 11 12:26:51.894132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.893659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fjlxr" event={"ID":"90374b8d-533a-41cc-b34a-512cc5f2ea79","Type":"ContainerStarted","Data":"094e041bbcb37ba159f748b6646ca5fa9d3d10f6f4fc9b46dd8d2605f11a633b"}
Sep 11 12:26:51.898356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.898325    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cq4jq" event={"ID":"01a582d3-2efd-40bb-bbee-42177f734634","Type":"ContainerStarted","Data":"a019905b5c0197f3c5442f4fe4c6b058a3241fe833fe99d8fb9b9446474ff649"}
Sep 11 12:26:51.903534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.903256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-989g7" event={"ID":"46166e53-54cb-485d-a443-6f099b77498f","Type":"ContainerStarted","Data":"265bcbe1ebf8e3a3b4d1ba14b4db9efa82431742b8ef603c01edb945108ccdef"}
Sep 11 12:26:51.909736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.909674    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25h7k" event={"ID":"ff43cf92-ce90-4553-a63a-6f814adf91e4","Type":"ContainerStarted","Data":"6bb83fd3794da536d730ff8fedf121c62a9c7bac30ccc15aa247e6ca070d609a"}
Sep 11 12:26:51.915534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.915261    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v7hs6" event={"ID":"eca52884-844e-44ac-bf10-ed9ed85ecece","Type":"ContainerStarted","Data":"26ace768a5b344c6390f5c1a71c1287a5096296df7f96dc6529d6bf9918ef1c3"}
Sep 11 12:26:51.918672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.918580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb" event={"ID":"771bf1c8-5437-484c-bbf5-633e05405a65","Type":"ContainerStarted","Data":"6144ca52e0f017e0d1cbcdc1040813d2602cb5fed0bfc1e10f1592618a2e0123"}
Sep 11 12:26:51.924818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.924003    2584 generic.go:356] "Generic (PLEG): container finished" podID="90c2b75851fd862a0e695ddba4b5ed7c" containerID="2e8f6719591dad7bf3ffabe21f830e22aaa5f9acedd7177e5786718dc78aec79" exitCode=0
Sep 11 12:26:51.924818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.924088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"90c2b75851fd862a0e695ddba4b5ed7c","Type":"ContainerDied","Data":"2e8f6719591dad7bf3ffabe21f830e22aaa5f9acedd7177e5786718dc78aec79"}
Sep 11 12:26:51.932996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.932665    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" event={"ID":"687ab058f6ce8f763e9516f8b1ddbd13","Type":"ContainerStarted","Data":"2c7fb8db4cde3def9e1e87bcfca2afaf7c3b5d1e9159bcf7df82a5ea6c0ce35a"}
Sep 11 12:26:51.939892 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.939790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"843e59d6b3f4d88c3b58d0c01afce0e87d471cec19c30991aef3ee58d8233bb3"}
Sep 11 12:26:51.955158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:51.953948    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr7qd" event={"ID":"24f01518-eb66-4676-ae1f-255e1732bb07","Type":"ContainerStarted","Data":"e14f3e179cf3b9ea8c89ccb9e94097dffacf234230b2777c896fd8b5657e792e"}
Sep 11 12:26:52.978655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:52.978511    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" event={"ID":"90c2b75851fd862a0e695ddba4b5ed7c","Type":"ContainerStarted","Data":"d7425bceb654a1863442452a03805a3379440193a78f49a84932674c7d1877aa"}
Sep 11 12:26:52.997353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:52.997273    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-248.ec2.internal" podStartSLOduration=3.997248698 podStartE2EDuration="3.997248698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:26:51.971615526 +0000 UTC m=+4.615508188" watchObservedRunningTime="2026-09-11 12:26:52.997248698 +0000 UTC m=+5.641141362"
Sep 11 12:26:53.428126 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.428084    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:53.428338 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.428168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:53.428338 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.428312    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:53.428455 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.428380    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:57.428356616 +0000 UTC m=+10.072249270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:53.428818 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.428794    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:53.428903 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.428852    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:57.428835281 +0000 UTC m=+10.072727944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:53.631672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.631530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:53.631863 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.631728    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:53.631863 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.631758    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:53.631863 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.631774    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:53.631863 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.631845    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:57.631821782 +0000 UTC m=+10.275714422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:53.872273 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.872231    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:53.872474 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.872373    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:53.873163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.872802    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:53.873163 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.872925    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:53.873163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:53.872999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:53.873163 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:53.873079    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:26:55.871105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:55.870803    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:55.871105 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:55.870947    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:26:55.871723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:55.871151    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:55.871723 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:55.871284    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:55.871723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:55.871374    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:55.871723 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:55.871472    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:57.467533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.467489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:57.468057 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.467566    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:57.468057 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.467668    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:57.468057 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.467727    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:05.467711573 +0000 UTC m=+18.111604224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:57.468057 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.467668    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:57.468057 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.467816    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:05.467795874 +0000 UTC m=+18.111688524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:57.670277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.670235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:57.670503 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.670406    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:57.670503 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.670432    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:57.670503 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.670456    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:57.670679 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.670524    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:05.670503637 +0000 UTC m=+18.314396288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:57.873481 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.873444    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:57.873672 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.873564    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:57.873672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.873572    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:57.873672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:57.873597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:57.873672 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.873663    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:57.873948 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:57.873717    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:26:59.874389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:59.874356    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:26:59.874811 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:59.874484    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:26:59.874867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:59.874837    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:26:59.874971 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:59.874941    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:26:59.875050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:26:59.874999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:26:59.875177 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:26:59.875122    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:01.874349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:01.874315    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:01.874792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:01.874316    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:01.874792 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:01.874434    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:01.874792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:01.874316    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:01.874792 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:01.874501    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:01.874792 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:01.874614    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:03.871565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:03.871528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:03.871565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:03.871565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:03.871959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:03.871528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:03.871959 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:03.871638    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:03.871959 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:03.871741    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:03.871959 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:03.871818    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:05.531825 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.531784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:05.532349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.531867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:05.532349 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.531952    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:05.532349 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.531997    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:05.532349 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.532047    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:21.532013039 +0000 UTC m=+34.175905736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:05.532349 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.532067    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:21.532059388 +0000 UTC m=+34.175952024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:05.733604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.733571    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:05.733739 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.733698    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:27:05.733739 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.733711    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:27:05.733739 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.733720    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:05.733846 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.733766    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:21.733754653 +0000 UTC m=+34.377647288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:05.871148 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.871042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:05.871148 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.871047    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:05.871360 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.871178    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:05.871360 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:05.871042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:05.871360 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.871248    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:05.871360 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:05.871338    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:07.872037 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:07.871985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:07.872463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:07.872116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:07.872463 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:07.872135    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:07.872463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:07.872221    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:07.872463 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:07.872237    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:07.872463 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:07.872297    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:09.870969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:09.870744    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:09.871844 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:09.870744    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:09.871844 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:09.870995    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:09.871844 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:09.870757    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:09.871844 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:09.871071    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:09.871844 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:09.871131    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:10.021257 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"44a98f583250c7ddf7a8a41cd7acc7582b29f6d54ad6e382f2396cf85e2b0f68"}
Sep 11 12:27:10.021441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"4d860c162504038290126a3aacdc664fdcfb56959f0edf1b591f37e8341e23ff"}
Sep 11 12:27:10.021441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021358    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"2eaf58e1574ca7b5ce30ea735e0d419b3b53b70ba8e78e48984d38c07a2d4d8c"}
Sep 11 12:27:10.021441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"a56d005d85aad70484709d729bd48d707ce3897f43c3783962fcd8c1ee765d30"}
Sep 11 12:27:10.021441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"70c188ba67bfc9e79baea7875075b451333452e7278d2db87c252baf31f5d37c"}
Sep 11 12:27:10.021612 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.021452    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"cd045f16b53e09248faf0f664a5ba669f002c1ee56d69d0c279431a7dee9385b"}
Sep 11 12:27:10.024488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.024448    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr7qd" event={"ID":"24f01518-eb66-4676-ae1f-255e1732bb07","Type":"ContainerStarted","Data":"47bb943143b400997a22fd9e1d8e93c6837f7a0d4101f6baba986a9bf7959ef4"}
Sep 11 12:27:10.027254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.027229    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="aa7d53577d18e607a678bb975e0de918bd90d44963bc235a979e31037fa6f319" exitCode=0
Sep 11 12:27:10.027389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.027319    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"aa7d53577d18e607a678bb975e0de918bd90d44963bc235a979e31037fa6f319"}
Sep 11 12:27:10.029394 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.029368    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fjlxr" event={"ID":"90374b8d-533a-41cc-b34a-512cc5f2ea79","Type":"ContainerStarted","Data":"50e3113ca5e357cabb368e2f5020a5ce2e6681bd70626b8fa70d7e3d477c452a"}
Sep 11 12:27:10.031020 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.030992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cq4jq" event={"ID":"01a582d3-2efd-40bb-bbee-42177f734634","Type":"ContainerStarted","Data":"f0b7f9e417afbd3694970abf73dc6b1b85b0c88e478c0292f3c5f2ebbc2241fc"}
Sep 11 12:27:10.032762 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.032729    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-989g7" event={"ID":"46166e53-54cb-485d-a443-6f099b77498f","Type":"ContainerStarted","Data":"5920829642a6d20fca34e1e1720a7110baa2b32992d208aeb6e6cee52ab5693f"}
Sep 11 12:27:10.034613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.034554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25h7k" event={"ID":"ff43cf92-ce90-4553-a63a-6f814adf91e4","Type":"ContainerStarted","Data":"b24c45101476a0fdb152dd853133998649fb6d48c56c7744dc1f364b421a5c3c"}
Sep 11 12:27:10.036186 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.036163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb" event={"ID":"771bf1c8-5437-484c-bbf5-633e05405a65","Type":"ContainerStarted","Data":"c6dade5f60e0345e3d20c4e8395cdc10d09f2d756f3f3f5c4af82b040abad43e"}
Sep 11 12:27:10.048981 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.048936    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-248.ec2.internal" podStartSLOduration=21.048920265 podStartE2EDuration="21.048920265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:26:52.998196722 +0000 UTC m=+5.642089388" watchObservedRunningTime="2026-09-11 12:27:10.048920265 +0000 UTC m=+22.692812924"
Sep 11 12:27:10.071811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.071774    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-989g7" podStartSLOduration=7.643150537 podStartE2EDuration="22.071762212s" totalImagesPullingTime="14.428611675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:10.071640105 +0000 UTC m=+22.715532762" watchObservedRunningTime="2026-09-11 12:27:10.071762212 +0000 UTC m=+22.715654851"
Sep 11 12:27:10.072396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.072359    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hr7qd" podStartSLOduration=7.638688722 podStartE2EDuration="22.072350671s" totalImagesPullingTime="14.433661949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:10.049097543 +0000 UTC m=+22.692990202" watchObservedRunningTime="2026-09-11 12:27:10.072350671 +0000 UTC m=+22.716243329"
Sep 11 12:27:10.090215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.090172    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fjlxr" podStartSLOduration=4.241473873 podStartE2EDuration="22.090159363s" totalImagesPullingTime="17.84868549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:10.089804753 +0000 UTC m=+22.733697410" watchObservedRunningTime="2026-09-11 12:27:10.090159363 +0000 UTC m=+22.734052016"
Sep 11 12:27:10.109490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.109442    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-25h7k" podStartSLOduration=4.216616307 podStartE2EDuration="22.109426735s" totalImagesPullingTime="17.892810428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:10.109150518 +0000 UTC m=+22.753043174" watchObservedRunningTime="2026-09-11 12:27:10.109426735 +0000 UTC m=+22.753319394"
Sep 11 12:27:10.145875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.145839    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cq4jq" podStartSLOduration=4.312685011 podStartE2EDuration="22.145824875s" totalImagesPullingTime="17.833139864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:10.123956569 +0000 UTC m=+22.767849226" watchObservedRunningTime="2026-09-11 12:27:10.145824875 +0000 UTC m=+22.789717531"
Sep 11 12:27:10.814645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.814620    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:27:10.815313 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.815296    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:27:10.935005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:10.934841    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:27:11.039929 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.039897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v7hs6" event={"ID":"eca52884-844e-44ac-bf10-ed9ed85ecece","Type":"ContainerStarted","Data":"b12480ec4e3577ee13ba68a3cc50075f50339d118e864a6f805fdbfb476fbf8a"}
Sep 11 12:27:11.041633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.041609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb" event={"ID":"771bf1c8-5437-484c-bbf5-633e05405a65","Type":"ContainerStarted","Data":"dfc8892ce6ca14af6722d2f29813d75e5ec384a7b804bb3a47d0a140de9a34fe"}
Sep 11 12:27:11.042208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.042186    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:27:11.042667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.042651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hr7qd"
Sep 11 12:27:11.072004 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.071893    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v7hs6" podStartSLOduration=5.227865194 podStartE2EDuration="23.071879761s" totalImagesPullingTime="17.844014567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:11.055687206 +0000 UTC m=+23.699579862" watchObservedRunningTime="2026-09-11 12:27:11.071879761 +0000 UTC m=+23.715772417"
Sep 11 12:27:11.843915 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.843750    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:27:10.934997674Z","UUID":"b53b118e-3885-4167-9c1c-d65d397a9049","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:27:11.845246 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.845223    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:27:11.845370 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.845257    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:27:11.871636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.871568    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:11.871636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.871582    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:11.871636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:11.871571    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:11.871890 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:11.871684    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:11.871890 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:11.871770    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:11.871890 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:11.871866    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:12.047209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:12.047180    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"f516061a7df7b330324f50a5146532d6fd8448de20f22150bc041c0d3011eed6"}
Sep 11 12:27:13.052235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.052196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb" event={"ID":"771bf1c8-5437-484c-bbf5-633e05405a65","Type":"ContainerStarted","Data":"8c498e7aa81e56d9de69f68cc0300df8c4c12c88b0b7978a44fbfef6b71f5306"}
Sep 11 12:27:13.074024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.073976    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dspb" podStartSLOduration=4.51110141 podStartE2EDuration="25.073962012s" totalImagesPullingTime="20.562860602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:13.073604471 +0000 UTC m=+25.717497128" watchObservedRunningTime="2026-09-11 12:27:13.073962012 +0000 UTC m=+25.717854668"
Sep 11 12:27:13.337403 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.337324    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:13.438645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.438604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:13.870850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.870708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:13.870976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.870708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:13.871045 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:13.870970    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:13.871045 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:13.870730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:13.871150 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:13.871073    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:13.871211 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:13.871140    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:14.062810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:14.062755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" event={"ID":"74cc5456-d9bd-4776-926b-185a4ecc6b8a","Type":"ContainerStarted","Data":"43f9817bdf0d34f42080069abd0dc7f1334d764a978770e58b609c7bc90c37c3"}
Sep 11 12:27:14.099815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:14.099760    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5" podStartSLOduration=8.175580205 podStartE2EDuration="26.099741152s" totalImagesPullingTime="17.924160947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:14.098942387 +0000 UTC m=+26.742835044" watchObservedRunningTime="2026-09-11 12:27:14.099741152 +0000 UTC m=+26.743633810"
Sep 11 12:27:15.013469 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.013415    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:15.066474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.066371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:15.066474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.066450    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:15.066980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.066498    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:15.087557 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.087528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:15.089982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.089957    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:15.114581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.114520    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:15.735817 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.735744    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rjjj9"]
Sep 11 12:27:15.736002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.735880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:15.736002 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:15.735980    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:15.738949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.738920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drh5s"]
Sep 11 12:27:15.739138 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.739044    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:15.739776 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.739633    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d2986"]
Sep 11 12:27:15.739776 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:15.739747    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:15.739776 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:15.739747    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:15.739939 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:15.739850    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:16.870630 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:16.870602    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:16.870630 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:16.870624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:16.871311 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:16.870708    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:16.871311 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:16.870852    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:17.073060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:17.072960    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="680d5b46d85c7820fd598af885db047518f8e22d106a9e3fdef3bab81e6e1792" exitCode=0
Sep 11 12:27:17.073207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:17.073062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"680d5b46d85c7820fd598af885db047518f8e22d106a9e3fdef3bab81e6e1792"}
Sep 11 12:27:17.871664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:17.871489    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:17.871986 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:17.871732    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:18.871183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:18.871149    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:18.871362 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:18.871149    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:18.871362 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:18.871277    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:18.871362 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:18.871324    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:19.080228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:19.080192    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="8868238a8cc2fbf0e59ee76c766caa11cfeaa5aa32fc805ce56729908b7d248b" exitCode=0
Sep 11 12:27:19.080676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:19.080254    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"8868238a8cc2fbf0e59ee76c766caa11cfeaa5aa32fc805ce56729908b7d248b"}
Sep 11 12:27:19.804560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:19.804522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:19.870980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:19.870950    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:19.871152 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:19.871074    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:19.903061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:19.903007    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:20.870925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:20.870836    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:20.871407 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:20.870842    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:20.871407 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:20.870964    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-drh5s" podUID="bb5a4b25-7707-43ea-aaef-50afeb3fb290"
Sep 11 12:27:20.871407 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:20.871007    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d2986" podUID="bda0ade2-4e30-4ccc-b3b3-53623c963601"
Sep 11 12:27:20.876531 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:20.876503    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:20.976794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:20.976760    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:21.087359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.087329    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="a674e08c84f3b375d2e9a7de050054124564e1295ab207b5389b8f69ac161258" exitCode=0
Sep 11 12:27:21.087547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.087369    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"a674e08c84f3b375d2e9a7de050054124564e1295ab207b5389b8f69ac161258"}
Sep 11 12:27:21.543866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.543836    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:21.544084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.543880    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:21.544084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.543966    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:21.544084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.544009    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs podName:bda0ade2-4e30-4ccc-b3b3-53623c963601 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:53.543996729 +0000 UTC m=+66.187889377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs") pod "network-metrics-daemon-d2986" (UID: "bda0ade2-4e30-4ccc-b3b3-53623c963601") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:21.544084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.543967    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:21.544216 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.544088    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret podName:bb5a4b25-7707-43ea-aaef-50afeb3fb290 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:53.544074688 +0000 UTC m=+66.187967324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret") pod "global-pull-secret-syncer-drh5s" (UID: "bb5a4b25-7707-43ea-aaef-50afeb3fb290") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:21.744397 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.744361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:21.744651 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.744519    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:27:21.744651 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.744537    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:27:21.744651 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.744548    2584 projected.go:196] Error preparing data for projected volume kube-api-access-gnb6h for pod openshift-network-diagnostics/network-check-target-rjjj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:21.744651 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.744598    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h podName:95777190-3fbd-4b35-a7f9-b9b2f3720e83 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:53.744584527 +0000 UTC m=+66.388477167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gnb6h" (UniqueName: "kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h") pod "network-check-target-rjjj9" (UID: "95777190-3fbd-4b35-a7f9-b9b2f3720e83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:21.871011 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:21.870980    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:21.871452 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:21.871123    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rjjj9" podUID="95777190-3fbd-4b35-a7f9-b9b2f3720e83"
Sep 11 12:27:22.659448 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.659407    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-248.ec2.internal" event="NodeReady"
Sep 11 12:27:22.659627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.659554    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:27:22.716998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.716965    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l89gq"]
Sep 11 12:27:22.736275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.736242    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rw6mm"]
Sep 11 12:27:22.736464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.736362    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.741490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.741051    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:27:22.741490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.741208    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-48qpm\""
Sep 11 12:27:22.741490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.741248    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:27:22.752279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.752257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l89gq"]
Sep 11 12:27:22.752279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.752291    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw6mm"]
Sep 11 12:27:22.752477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.752386    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.755605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.755584    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:27:22.756265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.756173    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:27:22.756265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.756204    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q7zjm\""
Sep 11 12:27:22.756413 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.756364    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:27:22.851063 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.850961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:22.852885 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.852869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdkrf\" (UniqueName: \"kubernetes.io/projected/8a027594-40cf-47c3-80e9-11d4a4fa2239-kube-api-access-zdkrf\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.852934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.852911    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a027594-40cf-47c3-80e9-11d4a4fa2239-tmp-dir\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.852979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.852963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a027594-40cf-47c3-80e9-11d4a4fa2239-config-volume\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.853016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.853008    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-cert\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.853061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.853039    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhs6\" (UniqueName: \"kubernetes.io/projected/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-kube-api-access-9fhs6\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.853094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.853061    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.871101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.871083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:22.871387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.871086    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:22.874053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.874016    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:27:22.874173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.874018    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfdf\""
Sep 11 12:27:22.874419 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.874404    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:27:22.926169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.926142    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:22.954158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-cert\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.954304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhs6\" (UniqueName: \"kubernetes.io/projected/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-kube-api-access-9fhs6\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.954304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.954304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdkrf\" (UniqueName: \"kubernetes.io/projected/8a027594-40cf-47c3-80e9-11d4a4fa2239-kube-api-access-zdkrf\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.954304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954274    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a027594-40cf-47c3-80e9-11d4a4fa2239-tmp-dir\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.954517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a027594-40cf-47c3-80e9-11d4a4fa2239-config-volume\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.954517 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:22.954320    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:22.954517 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:22.954387    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:23.45436817 +0000 UTC m=+36.098260830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:22.954724 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a027594-40cf-47c3-80e9-11d4a4fa2239-tmp-dir\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.954835 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.954818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a027594-40cf-47c3-80e9-11d4a4fa2239-config-volume\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.959448 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.959293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-cert\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:22.965284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.965258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdkrf\" (UniqueName: \"kubernetes.io/projected/8a027594-40cf-47c3-80e9-11d4a4fa2239-kube-api-access-zdkrf\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:22.965367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:22.965288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhs6\" (UniqueName: \"kubernetes.io/projected/bb6265ee-2d15-43e6-b7e4-e0e28eb01388-kube-api-access-9fhs6\") pod \"ingress-canary-rw6mm\" (UID: \"bb6265ee-2d15-43e6-b7e4-e0e28eb01388\") " pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:23.063128 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.063097    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw6mm"
Sep 11 12:27:23.392470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.392436    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw6mm"]
Sep 11 12:27:23.396248 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:23.396172    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6265ee_2d15_43e6_b7e4_e0e28eb01388.slice/crio-652fdb4c217c1e96eeeecafd19aa03d0fb8149c31735dd2d3d9897538ae115d1 WatchSource:0}: Error finding container 652fdb4c217c1e96eeeecafd19aa03d0fb8149c31735dd2d3d9897538ae115d1: Status 404 returned error can't find the container with id 652fdb4c217c1e96eeeecafd19aa03d0fb8149c31735dd2d3d9897538ae115d1
Sep 11 12:27:23.459470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.459392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:23.459628 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:23.459534    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:23.459628 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:23.459607    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:24.459587818 +0000 UTC m=+37.103480466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:23.870673 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.870640    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:23.873944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.873707    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6d4p\""
Sep 11 12:27:23.873944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.873739    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:27:23.873944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:23.873848    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:27:24.096668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:24.096632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw6mm" event={"ID":"bb6265ee-2d15-43e6-b7e4-e0e28eb01388","Type":"ContainerStarted","Data":"652fdb4c217c1e96eeeecafd19aa03d0fb8149c31735dd2d3d9897538ae115d1"}
Sep 11 12:27:24.469375 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:24.469336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:24.469577 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:24.469521    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:24.469636 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:24.469605    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:26.469583534 +0000 UTC m=+39.113476175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:26.483739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:26.483702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:26.484366 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:26.483829    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:26.484366 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:26.483901    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.483885179 +0000 UTC m=+43.127777814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:27.364979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:27.364925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:27.465776 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:27.465735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:28.109178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:28.109144    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="13aa584e44b8ce17884424b345c6d4220510634b2b94f4de997e9646d8dcbbf1" exitCode=0
Sep 11 12:27:28.109655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:28.109214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"13aa584e44b8ce17884424b345c6d4220510634b2b94f4de997e9646d8dcbbf1"}
Sep 11 12:27:28.110764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:28.110735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw6mm" event={"ID":"bb6265ee-2d15-43e6-b7e4-e0e28eb01388","Type":"ContainerStarted","Data":"473bbb4edff7e4f4fb23f8284d08a8a04324c1a91b46e1a262c367a1d8101288"}
Sep 11 12:27:28.151740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:28.151689    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rw6mm" podStartSLOduration=2.215041174 podStartE2EDuration="6.151669571s" totalImagesPullingTime="3.936628397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:28.151262978 +0000 UTC m=+40.795155627" watchObservedRunningTime="2026-09-11 12:27:28.151669571 +0000 UTC m=+40.795562226"
Sep 11 12:27:29.116075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.116038    2584 generic.go:356] "Generic (PLEG): container finished" podID="a5f79f29-400f-49f9-b359-0d77dc97edd9" containerID="0ff89aa78e8a9d39a0b315ec86b4299039cad73e6ad3921520c21f62684f8753" exitCode=0
Sep 11 12:27:29.116454 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.116125    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerDied","Data":"0ff89aa78e8a9d39a0b315ec86b4299039cad73e6ad3921520c21f62684f8753"}
Sep 11 12:27:29.307999 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.307964    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"]
Sep 11 12:27:29.328878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.328843    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"]
Sep 11 12:27:29.329046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.328966    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"
Sep 11 12:27:29.332175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.332152    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.332375 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.332357    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.332486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.332471    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-622ll\""
Sep 11 12:27:29.349015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.348988    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:27:29.349137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.349123    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.351877 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.351855    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 12:27:29.351970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.351855    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x75ll\""
Sep 11 12:27:29.352189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.352171    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.352268 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.352241    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.372568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.372506    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"]
Sep 11 12:27:29.372568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.372541    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"]
Sep 11 12:27:29.372568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.372567    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:27:29.372731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.372629    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.375418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.375397    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 12:27:29.375698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.375682    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 12:27:29.375783 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.375701    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zqm8\""
Sep 11 12:27:29.376167 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.376153    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 12:27:29.381705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.381686    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 12:27:29.404683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.404656    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-5cb65"]
Sep 11 12:27:29.424567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.424542    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5cb65"]
Sep 11 12:27:29.424680 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.424630    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.427535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.427515    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qsgnj\""
Sep 11 12:27:29.427657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.427560    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.427657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.427566    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 12:27:29.427770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.427758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 12:27:29.427821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.427759    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.433305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.433288    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 12:27:29.495543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.495502    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"]
Sep 11 12:27:29.507698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.507839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507723    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.507839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57lfc\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.507839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.507839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507839    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507879    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thq44\" (UniqueName: \"kubernetes.io/projected/d8928d2e-d1d5-4ca9-972a-45325e9cab63-kube-api-access-thq44\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507930    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9ms\" (UniqueName: \"kubernetes.io/projected/cc882b4a-ec80-4df3-9780-3695d551267b-kube-api-access-tz9ms\") pod \"volume-data-source-validator-86695b7cc7-m4ksr\" (UID: \"cc882b4a-ec80-4df3-9780-3695d551267b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"
Sep 11 12:27:29.508068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.507981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.508666 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.508651    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"]
Sep 11 12:27:29.508777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.508766    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.511533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.511512    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 12:27:29.511654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.511553    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 12:27:29.511654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.511522    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-69t66\""
Sep 11 12:27:29.518783 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.518763    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"]
Sep 11 12:27:29.518876 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.518847    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.519168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.519146    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"]
Sep 11 12:27:29.521463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.521446    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.521669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.521653    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 12:27:29.522038 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.522005    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8wtpq\""
Sep 11 12:27:29.522115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.522049    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.522259 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.522239    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 12:27:29.608634 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.608634 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57lfc\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-service-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.608775    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.608799    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.608848    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.608863    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.108843197 +0000 UTC m=+42.752735832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.608894 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.608903    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls podName:d8928d2e-d1d5-4ca9-972a-45325e9cab63 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.108887673 +0000 UTC m=+42.752780317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s77r6" (UID: "d8928d2e-d1d5-4ca9-972a-45325e9cab63") : secret "samples-operator-tls" not found
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thq44\" (UniqueName: \"kubernetes.io/projected/d8928d2e-d1d5-4ca9-972a-45325e9cab63-kube-api-access-thq44\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.608982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-tmp\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9ms\" (UniqueName: \"kubernetes.io/projected/cc882b4a-ec80-4df3-9780-3695d551267b-kube-api-access-tz9ms\") pod \"volume-data-source-validator-86695b7cc7-m4ksr\" (UID: \"cc882b4a-ec80-4df3-9780-3695d551267b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-snapshots\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vb2\" (UniqueName: \"kubernetes.io/projected/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-kube-api-access-p9vb2\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609160    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8997d8d1-043e-492b-a884-18a1ecfeb61c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609185    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-serving-cert\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.609359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609281    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.609912 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.609896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.611753 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.611731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.611753 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.611743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.618320 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.618295    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57lfc\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.618410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.618370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:29.618798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.618781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thq44\" (UniqueName: \"kubernetes.io/projected/d8928d2e-d1d5-4ca9-972a-45325e9cab63-kube-api-access-thq44\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:29.619393 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.619375    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9ms\" (UniqueName: \"kubernetes.io/projected/cc882b4a-ec80-4df3-9780-3695d551267b-kube-api-access-tz9ms\") pod \"volume-data-source-validator-86695b7cc7-m4ksr\" (UID: \"cc882b4a-ec80-4df3-9780-3695d551267b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"
Sep 11 12:27:29.631986 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.631929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:29.637669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.637649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"
Sep 11 12:27:29.710365 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710278    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b116c624-3915-473b-8932-70a802b8527d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.710459 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.710459 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-service-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.710791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-tmp\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.710791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-snapshots\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.710791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vb2\" (UniqueName: \"kubernetes.io/projected/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-kube-api-access-p9vb2\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.710791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.710604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8997d8d1-043e-492b-a884-18a1ecfeb61c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-service-ca-bundle\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-snapshots\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711477    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b116c624-3915-473b-8932-70a802b8527d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-serving-cert\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrs8\" (UniqueName: \"kubernetes.io/projected/b116c624-3915-473b-8932-70a802b8527d-kube-api-access-msrs8\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.711561    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:29.711641    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.211621423 +0000 UTC m=+42.855514060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.711867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-tmp\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.712543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.712352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8997d8d1-043e-492b-a884-18a1ecfeb61c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:29.714559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.714457    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-serving-cert\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.731614 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.731530    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vb2\" (UniqueName: \"kubernetes.io/projected/1b3f976d-9792-4e0b-86a2-2389fbb41ebc-kube-api-access-p9vb2\") pod \"insights-operator-5844b856db-5cb65\" (UID: \"1b3f976d-9792-4e0b-86a2-2389fbb41ebc\") " pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.734213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.734178    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:29.744919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.744898    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5cb65"
Sep 11 12:27:29.806447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.806402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:29.812253 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.812225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b116c624-3915-473b-8932-70a802b8527d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.812378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.812267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrs8\" (UniqueName: \"kubernetes.io/projected/b116c624-3915-473b-8932-70a802b8527d-kube-api-access-msrs8\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.812378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.812315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b116c624-3915-473b-8932-70a802b8527d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.812893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.812871    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b116c624-3915-473b-8932-70a802b8527d-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.814431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.814414    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b116c624-3915-473b-8932-70a802b8527d-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.824388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.824358    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrs8\" (UniqueName: \"kubernetes.io/projected/b116c624-3915-473b-8932-70a802b8527d-kube-api-access-msrs8\") pod \"kube-storage-version-migrator-operator-6c8f84f897-q5dll\" (UID: \"b116c624-3915-473b-8932-70a802b8527d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.827226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.826682    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"
Sep 11 12:27:29.934837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:29.934812    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr"]
Sep 11 12:27:29.937222 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:29.937195    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc882b4a_ec80_4df3_9780_3695d551267b.slice/crio-53134079b75442d7ba0a5f77c690c5898f9a570832d40c743e07c8ed65731fc3 WatchSource:0}: Error finding container 53134079b75442d7ba0a5f77c690c5898f9a570832d40c743e07c8ed65731fc3: Status 404 returned error can't find the container with id 53134079b75442d7ba0a5f77c690c5898f9a570832d40c743e07c8ed65731fc3
Sep 11 12:27:30.040863 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.040833    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5cb65"]
Sep 11 12:27:30.043908 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:30.043882    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3f976d_9792_4e0b_86a2_2389fbb41ebc.slice/crio-d04af91210328a3df838bc46a32f8abbe2b7e70b533d5e7582053b574897ceed WatchSource:0}: Error finding container d04af91210328a3df838bc46a32f8abbe2b7e70b533d5e7582053b574897ceed: Status 404 returned error can't find the container with id d04af91210328a3df838bc46a32f8abbe2b7e70b533d5e7582053b574897ceed
Sep 11 12:27:30.114782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.114753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:30.114950 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.114797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:30.114950 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.114910    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:30.114950 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.114935    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:30.115084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.114991    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.114973942 +0000 UTC m=+43.758866578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:30.115084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.114918    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:27:30.115084 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.115073    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls podName:d8928d2e-d1d5-4ca9-972a-45325e9cab63 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.115060029 +0000 UTC m=+43.758952664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s77r6" (UID: "d8928d2e-d1d5-4ca9-972a-45325e9cab63") : secret "samples-operator-tls" not found
Sep 11 12:27:30.121575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.121544    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5cb65" event={"ID":"1b3f976d-9792-4e0b-86a2-2389fbb41ebc","Type":"ContainerStarted","Data":"d04af91210328a3df838bc46a32f8abbe2b7e70b533d5e7582053b574897ceed"}
Sep 11 12:27:30.121968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.121603    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll"]
Sep 11 12:27:30.122898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.122834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr" event={"ID":"cc882b4a-ec80-4df3-9780-3695d551267b","Type":"ContainerStarted","Data":"53134079b75442d7ba0a5f77c690c5898f9a570832d40c743e07c8ed65731fc3"}
Sep 11 12:27:30.124847 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:30.124826    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb116c624_3915_473b_8932_70a802b8527d.slice/crio-1e29cd65901e3376a8fc0bfeeb6a404777e7744b00d10a77df1cc416aae7dca1 WatchSource:0}: Error finding container 1e29cd65901e3376a8fc0bfeeb6a404777e7744b00d10a77df1cc416aae7dca1: Status 404 returned error can't find the container with id 1e29cd65901e3376a8fc0bfeeb6a404777e7744b00d10a77df1cc416aae7dca1
Sep 11 12:27:30.126262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.126225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" event={"ID":"a5f79f29-400f-49f9-b359-0d77dc97edd9","Type":"ContainerStarted","Data":"ad7aad73b4ecc6f2a6217068a0d105fb5056364ace007ef675b06cf17e3d0b64"}
Sep 11 12:27:30.152442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.152361    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rvqw4" podStartSLOduration=9.16273496 podStartE2EDuration="42.152347297s" totalImagesPullingTime="32.989612337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:30.151017607 +0000 UTC m=+42.794910263" watchObservedRunningTime="2026-09-11 12:27:30.152347297 +0000 UTC m=+42.796239953"
Sep 11 12:27:30.216272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.216237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:30.216405 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.216382    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:30.216456 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.216447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.216431765 +0000 UTC m=+43.860324400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:30.517967 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.517918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:30.518156 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.518063    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:30.518156 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:30.518145    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:38.518127822 +0000 UTC m=+51.162020458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:30.789880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.789788    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:30.894543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.894510    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:30.994648 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:30.994613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:31.091794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.091714    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:31.121888 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.121849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.121917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.121990    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.122012    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.122068    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.122097    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.12207698 +0000 UTC m=+45.765969619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:31.122339 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.122125    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls podName:d8928d2e-d1d5-4ca9-972a-45325e9cab63 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.122108966 +0000 UTC m=+45.766001629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s77r6" (UID: "d8928d2e-d1d5-4ca9-972a-45325e9cab63") : secret "samples-operator-tls" not found
Sep 11 12:27:31.130584 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.130541    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll" event={"ID":"b116c624-3915-473b-8932-70a802b8527d","Type":"ContainerStarted","Data":"1e29cd65901e3376a8fc0bfeeb6a404777e7744b00d10a77df1cc416aae7dca1"}
Sep 11 12:27:31.222417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.222377    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:31.222631 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.222587    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:31.222693 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:31.222650    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.222635772 +0000 UTC m=+45.866528407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:31.654170 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.654133    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:31.734690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:31.734649    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:32.134512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:32.134479    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr" event={"ID":"cc882b4a-ec80-4df3-9780-3695d551267b","Type":"ContainerStarted","Data":"4b86e4b9d028f981ef0152c5cc100fa2e19a060969426e689e707e47cddc5e8a"}
Sep 11 12:27:32.151903 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:32.151769    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-m4ksr" podStartSLOduration=1.137754694 podStartE2EDuration="3.151750811s" totalImagesPullingTime="2.013996117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:32.151649526 +0000 UTC m=+44.795542180" watchObservedRunningTime="2026-09-11 12:27:32.151750811 +0000 UTC m=+44.795643449"
Sep 11 12:27:32.274024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:32.273965    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:32.379489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:32.379446    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:33.137369 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:33.137339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:33.137389    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.137598    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.137611    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.137619    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.137670    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls podName:d8928d2e-d1d5-4ca9-972a-45325e9cab63 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.137653481 +0000 UTC m=+49.781546133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s77r6" (UID: "d8928d2e-d1d5-4ca9-972a-45325e9cab63") : secret "samples-operator-tls" not found
Sep 11 12:27:33.137820 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.137683    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.1376771 +0000 UTC m=+49.781569736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:33.238345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:33.238302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:33.238513 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.238490    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:33.238575 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:33.238568    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.238547927 +0000 UTC m=+49.882440579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:35.144501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:35.144460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5cb65" event={"ID":"1b3f976d-9792-4e0b-86a2-2389fbb41ebc","Type":"ContainerStarted","Data":"063e7ac9c1f29af6a747c7cd974f39537bb7324fedcaee9e5a24649ce3004615"}
Sep 11 12:27:35.146086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:35.146061    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll" event={"ID":"b116c624-3915-473b-8932-70a802b8527d","Type":"ContainerStarted","Data":"084f9512b12dd1e504e7d7022d7f7deca0ed0f4f7b32a71bca280ca90ff056fd"}
Sep 11 12:27:35.166887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:35.166842    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-5cb65" podStartSLOduration=1.544992201 podStartE2EDuration="6.166827553s" totalImagesPullingTime="4.621835352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:35.165777293 +0000 UTC m=+47.809669952" watchObservedRunningTime="2026-09-11 12:27:35.166827553 +0000 UTC m=+47.810720210"
Sep 11 12:27:35.189238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:35.189185    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll" podStartSLOduration=1.653143317 podStartE2EDuration="6.189164339s" totalImagesPullingTime="4.536021022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:35.187570138 +0000 UTC m=+47.831462795" watchObservedRunningTime="2026-09-11 12:27:35.189164339 +0000 UTC m=+47.833056998"
Sep 11 12:27:36.304094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.304058    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vzdjd"]
Sep 11 12:27:36.327233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.327191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vzdjd"]
Sep 11 12:27:36.327408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.327343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.330972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.330945    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:27:36.331144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.331004    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:27:36.331144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.331050    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9m2p7\""
Sep 11 12:27:36.366920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.366884    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae144019-341c-4807-8332-29f6161af077-data-volume\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.366920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.366917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckmn5\" (UniqueName: \"kubernetes.io/projected/ae144019-341c-4807-8332-29f6161af077-kube-api-access-ckmn5\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.367142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.366936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.367142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.367022    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae144019-341c-4807-8332-29f6161af077-crio-socket\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.367142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.367126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467652    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae144019-341c-4807-8332-29f6161af077-data-volume\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckmn5\" (UniqueName: \"kubernetes.io/projected/ae144019-341c-4807-8332-29f6161af077-kube-api-access-ckmn5\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae144019-341c-4807-8332-29f6161af077-crio-socket\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.467981 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.467945    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:36.468019 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.467974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae144019-341c-4807-8332-29f6161af077-crio-socket\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.468019 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.467946    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.468113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.468052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae144019-341c-4807-8332-29f6161af077-data-volume\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.468113 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.468063    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:36.968045722 +0000 UTC m=+49.611938372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:36.468113 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.468080    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:36.968072565 +0000 UTC m=+49.611965200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.485185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.485152    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckmn5\" (UniqueName: \"kubernetes.io/projected/ae144019-341c-4807-8332-29f6161af077-kube-api-access-ckmn5\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.605326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.605235    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:36.706747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.706712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:36.918007 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.917899    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:36.971172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.971139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.971291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:36.971251    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:36.971328 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.971296    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.971360 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.971327    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:36.971393 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.971374    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.971353278 +0000 UTC m=+50.615245918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.971393 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:36.971390    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.971383738 +0000 UTC m=+50.615276374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:37.021266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.021220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:37.173794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.173709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.173801    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.173864    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.173881    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.173896    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.173955    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls podName:d8928d2e-d1d5-4ca9-972a-45325e9cab63 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.173937414 +0000 UTC m=+57.817830065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s77r6" (UID: "d8928d2e-d1d5-4ca9-972a-45325e9cab63") : secret "samples-operator-tls" not found
Sep 11 12:27:37.174015 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.173981    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.173975824 +0000 UTC m=+57.817868459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:37.274749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.274711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:37.274909 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.274850    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:37.274909 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.274906    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.274892269 +0000 UTC m=+57.918784904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:37.662711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.662664    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:37.733072 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.733023    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:37.979914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.979821    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:37.979914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:37.979888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:37.980143 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.979946    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:37.980143 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.980014    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:39.979998535 +0000 UTC m=+52.623891170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:37.980143 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.980093    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:37.980243 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:37.980160    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:39.980144565 +0000 UTC m=+52.624037214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:38.252823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:38.252796    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cq4jq_01a582d3-2efd-40bb-bbee-42177f734634/dns-node-resolver/0.log"
Sep 11 12:27:38.585111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:38.585003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:38.585269 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:38.585164    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:38.585269 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:38.585233    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls podName:8a027594-40cf-47c3-80e9-11d4a4fa2239 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:54.585216987 +0000 UTC m=+67.229109635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls") pod "dns-default-l89gq" (UID: "8a027594-40cf-47c3-80e9-11d4a4fa2239") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:38.936860 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:38.936761    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:39.053783 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:39.053756    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-989g7_46166e53-54cb-485d-a443-6f099b77498f/node-ca/0.log"
Sep 11 12:27:39.996157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:39.996124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:39.996523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:39.996257    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:39.996523 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:39.996285    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:39.996523 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:39.996354    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:43.996340792 +0000 UTC m=+56.640233432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:39.996523 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:39.996376    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:39.996523 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:39.996440    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:43.996427499 +0000 UTC m=+56.640320138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:40.244751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:40.244718    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw6mm_bb6265ee-2d15-43e6-b7e4-e0e28eb01388/serve-healthcheck-canary/0.log"
Sep 11 12:27:42.324804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:42.324772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:42.426946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:42.426902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:42.532131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:42.532097    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:42.629606 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:42.629522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:42.727765 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:42.727728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:44.031914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.031871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:44.032315 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.031933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:44.032315 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:44.032001    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:44.032315 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:44.032068    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:44.032315 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:44.032089    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:52.03207137 +0000 UTC m=+64.675964005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:44.032315 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:44.032107    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:52.032096547 +0000 UTC m=+64.675989183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:44.284120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.284012    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:44.352589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.352535    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:44.426826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.426775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:44.627923 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.627831    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:44.835511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:44.835480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:45.023555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.023523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:45.243658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.243625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:27:45.244085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.243749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:45.244085 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:45.243777    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:45.244085 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:45.243797    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bdd5c6bc-dzj2h: secret "image-registry-tls" not found
Sep 11 12:27:45.244085 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:45.243851    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls podName:4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a nodeName:}" failed. No retries permitted until 2026-09-11 12:28:01.243835325 +0000 UTC m=+73.887727961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls") pod "image-registry-64bdd5c6bc-dzj2h" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a") : secret "image-registry-tls" not found
Sep 11 12:27:45.246087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.246067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8928d2e-d1d5-4ca9-972a-45325e9cab63-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s77r6\" (UID: \"d8928d2e-d1d5-4ca9-972a-45325e9cab63\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:45.257084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.257061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"
Sep 11 12:27:45.344976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.344930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:27:45.345147 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:45.345112    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 12:27:45.345188 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:45.345171    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert podName:8997d8d1-043e-492b-a884-18a1ecfeb61c nodeName:}" failed. No retries permitted until 2026-09-11 12:28:01.345156178 +0000 UTC m=+73.989048830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-89nf9" (UID: "8997d8d1-043e-492b-a884-18a1ecfeb61c") : secret "networking-console-plugin-cert" not found
Sep 11 12:27:45.528467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:45.528440    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6"]
Sep 11 12:27:46.027149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.027109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:46.090765 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.090693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:46.173518 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.173486    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6" event={"ID":"d8928d2e-d1d5-4ca9-972a-45325e9cab63","Type":"ContainerStarted","Data":"410be8951a572bbd004d089c2adcda48a25422969a8a697053dae032750d8a0e"}
Sep 11 12:27:46.218823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.218786    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:46.443992 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.443885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:46.652662 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.652623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:46.725807 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:46.725724    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:47.084934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:47.084910    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4c2f5"
Sep 11 12:27:47.624651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:47.624590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:47.824347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:47.824303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:48.180969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.180879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6" event={"ID":"d8928d2e-d1d5-4ca9-972a-45325e9cab63","Type":"ContainerStarted","Data":"900a43f62a240dccb179fb9c02dd92a6184089e021acb54d2a011b2a8e05230a"}
Sep 11 12:27:48.180969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.180945    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6" event={"ID":"d8928d2e-d1d5-4ca9-972a-45325e9cab63","Type":"ContainerStarted","Data":"8fe6ed59690df444dfd51b6624bf8778f5117552045905a0abf0d740c33c5ce6"}
Sep 11 12:27:48.201672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.201614    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s77r6" podStartSLOduration=17.329508271 podStartE2EDuration="19.201598045s" totalImagesPullingTime="1.872089774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:48.201569855 +0000 UTC m=+60.845462512" watchObservedRunningTime="2026-09-11 12:27:48.201598045 +0000 UTC m=+60.845490701"
Sep 11 12:27:48.244891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.244849    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:48.420480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.420435    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:48.528243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.528208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:48.835639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:48.835546    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.114200 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.114159    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.215190 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.215137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.315891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.315861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.416678 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.416591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.624808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.624762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:50.852271 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:50.852223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:51.612881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:51.612853    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:51.818318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:51.818276    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:52.023350 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.023318    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:52.102723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.102688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:52.102863 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.102823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:52.102863 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:52.102847    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:52.102937 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:27:52.102925    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls podName:ae144019-341c-4807-8332-29f6161af077 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:08.102908075 +0000 UTC m=+80.746800724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vzdjd" (UID: "ae144019-341c-4807-8332-29f6161af077") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:52.103436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.103420    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae144019-341c-4807-8332-29f6161af077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:27:52.428191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.428068    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:52.813711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:52.813666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:53.021132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.021089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:27:53.615987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.615948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:53.616184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.616078    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:53.618831 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.618814    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:27:53.620278 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.620261    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:27:53.628712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.628684    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bda0ade2-4e30-4ccc-b3b3-53623c963601-metrics-certs\") pod \"network-metrics-daemon-d2986\" (UID: \"bda0ade2-4e30-4ccc-b3b3-53623c963601\") " pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:53.628832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.628730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5a4b25-7707-43ea-aaef-50afeb3fb290-original-pull-secret\") pod \"global-pull-secret-syncer-drh5s\" (UID: \"bb5a4b25-7707-43ea-aaef-50afeb3fb290\") " pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:53.779656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.779619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-drh5s"
Sep 11 12:27:53.786891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.786865    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfdf\""
Sep 11 12:27:53.795158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.795125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d2986"
Sep 11 12:27:53.817760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.817709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:53.821195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.821176    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:27:53.831248 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.831157    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:27:53.841661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.841633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnb6h\" (UniqueName: \"kubernetes.io/projected/95777190-3fbd-4b35-a7f9-b9b2f3720e83-kube-api-access-gnb6h\") pod \"network-check-target-rjjj9\" (UID: \"95777190-3fbd-4b35-a7f9-b9b2f3720e83\") " pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:53.884664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.884590    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6d4p\""
Sep 11 12:27:53.892904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:53.892876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:54.050661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.050619    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-drh5s"]
Sep 11 12:27:54.053208 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:54.053176    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a4b25_7707_43ea_aaef_50afeb3fb290.slice/crio-f4dcc80b67f4cb8ab1294525e1421d6240dda4d3bbe1761e02173eb245e6f646 WatchSource:0}: Error finding container f4dcc80b67f4cb8ab1294525e1421d6240dda4d3bbe1761e02173eb245e6f646: Status 404 returned error can't find the container with id f4dcc80b67f4cb8ab1294525e1421d6240dda4d3bbe1761e02173eb245e6f646
Sep 11 12:27:54.072109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.072081    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d2986"]
Sep 11 12:27:54.076126 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:54.076095    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda0ade2_4e30_4ccc_b3b3_53623c963601.slice/crio-c0f00775541f6ab5ea9ffa0234af26d109a5b5813a687c687a6687d6c648e87d WatchSource:0}: Error finding container c0f00775541f6ab5ea9ffa0234af26d109a5b5813a687c687a6687d6c648e87d: Status 404 returned error can't find the container with id c0f00775541f6ab5ea9ffa0234af26d109a5b5813a687c687a6687d6c648e87d
Sep 11 12:27:54.161445 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.161358    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rjjj9"]
Sep 11 12:27:54.163917 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:54.163894    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95777190_3fbd_4b35_a7f9_b9b2f3720e83.slice/crio-bd07324508d2af9cd2e500660ab511d0c847d1e2861ec901fc00ffcbf0425c87 WatchSource:0}: Error finding container bd07324508d2af9cd2e500660ab511d0c847d1e2861ec901fc00ffcbf0425c87: Status 404 returned error can't find the container with id bd07324508d2af9cd2e500660ab511d0c847d1e2861ec901fc00ffcbf0425c87
Sep 11 12:27:54.203775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.203734    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drh5s" event={"ID":"bb5a4b25-7707-43ea-aaef-50afeb3fb290","Type":"ContainerStarted","Data":"f4dcc80b67f4cb8ab1294525e1421d6240dda4d3bbe1761e02173eb245e6f646"}
Sep 11 12:27:54.204897 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.204875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rjjj9" event={"ID":"95777190-3fbd-4b35-a7f9-b9b2f3720e83","Type":"ContainerStarted","Data":"bd07324508d2af9cd2e500660ab511d0c847d1e2861ec901fc00ffcbf0425c87"}
Sep 11 12:27:54.205949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.205931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2986" event={"ID":"bda0ade2-4e30-4ccc-b3b3-53623c963601","Type":"ContainerStarted","Data":"c0f00775541f6ab5ea9ffa0234af26d109a5b5813a687c687a6687d6c648e87d"}
Sep 11 12:27:54.624355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.624314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:54.626963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.626922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a027594-40cf-47c3-80e9-11d4a4fa2239-metrics-tls\") pod \"dns-default-l89gq\" (UID: \"8a027594-40cf-47c3-80e9-11d4a4fa2239\") " pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:54.851589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.851551    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-48qpm\""
Sep 11 12:27:54.859318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:54.859279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l89gq"
Sep 11 12:27:55.150009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:55.149920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l89gq"]
Sep 11 12:27:55.242516 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:27:55.242481    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a027594_40cf_47c3_80e9_11d4a4fa2239.slice/crio-9db5ff40ab06f5d5612b4f63327796505dda0f6a6109e6815bc35179c72c5f82 WatchSource:0}: Error finding container 9db5ff40ab06f5d5612b4f63327796505dda0f6a6109e6815bc35179c72c5f82: Status 404 returned error can't find the container with id 9db5ff40ab06f5d5612b4f63327796505dda0f6a6109e6815bc35179c72c5f82
Sep 11 12:27:56.219555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:56.219426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2986" event={"ID":"bda0ade2-4e30-4ccc-b3b3-53623c963601","Type":"ContainerStarted","Data":"815fb3ee55f8e9d787f3291b4d7b22218130f8d490e3c43d332ab5bfb5dd3877"}
Sep 11 12:27:56.219555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:56.219503    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d2986" event={"ID":"bda0ade2-4e30-4ccc-b3b3-53623c963601","Type":"ContainerStarted","Data":"6befa04f7adc207ef0285b85b71710ccf9ecb9973119708890be31f73442f396"}
Sep 11 12:27:56.220983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:56.220951    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l89gq" event={"ID":"8a027594-40cf-47c3-80e9-11d4a4fa2239","Type":"ContainerStarted","Data":"9db5ff40ab06f5d5612b4f63327796505dda0f6a6109e6815bc35179c72c5f82"}
Sep 11 12:27:56.240706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:56.240647    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d2986" podStartSLOduration=67.023076233 podStartE2EDuration="1m8.240626673s" totalImagesPullingTime="1.21755044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:56.240334919 +0000 UTC m=+68.884227578" watchObservedRunningTime="2026-09-11 12:27:56.240626673 +0000 UTC m=+68.884519365"
Sep 11 12:27:59.232665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:59.232622    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-drh5s" event={"ID":"bb5a4b25-7707-43ea-aaef-50afeb3fb290","Type":"ContainerStarted","Data":"fcd37b76f317d30f26d6585aa2b27c1ac434ab278dcf5f8ac2d79e7ad18cfa2b"}
Sep 11 12:27:59.234450 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:59.234421    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rjjj9" event={"ID":"95777190-3fbd-4b35-a7f9-b9b2f3720e83","Type":"ContainerStarted","Data":"8e6f358ac1b5f92699a7990d8c52a91ace8d89d2c8639823b6043f6cf96cdf42"}
Sep 11 12:27:59.234602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:59.234564    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:27:59.271205 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:59.271152    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rjjj9" podStartSLOduration=66.743073305 podStartE2EDuration="1m11.271134718s" totalImagesPullingTime="4.528061413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:59.270461683 +0000 UTC m=+71.914354341" watchObservedRunningTime="2026-09-11 12:27:59.271134718 +0000 UTC m=+71.915027374"
Sep 11 12:27:59.271430 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:27:59.271406    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-drh5s" podStartSLOduration=66.629019989 podStartE2EDuration="1m11.271396294s" totalImagesPullingTime="4.642376305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:59.252421429 +0000 UTC m=+71.896314087" watchObservedRunningTime="2026-09-11 12:27:59.271396294 +0000 UTC m=+71.915288951"
Sep 11 12:28:00.092706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:00.092669    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:00.168562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:00.168530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:00.239593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:00.239554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l89gq" event={"ID":"8a027594-40cf-47c3-80e9-11d4a4fa2239","Type":"ContainerStarted","Data":"84484ad739706bc3a6ad0bbb6b3cadac71fc55d4277d925234d692b24fbef5db"}
Sep 11 12:28:01.244908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.244874    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l89gq" event={"ID":"8a027594-40cf-47c3-80e9-11d4a4fa2239","Type":"ContainerStarted","Data":"a26ecd6b6fb0db507b0fac2af5309195f3ae66a476b7f6a4357038e04daa6dcd"}
Sep 11 12:28:01.245298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.244939    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l89gq"
Sep 11 12:28:01.267676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.267623    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l89gq" podStartSLOduration=34.437475141 podStartE2EDuration="39.267605457s" totalImagesPullingTime="4.830130316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:01.26565745 +0000 UTC m=+73.909550104" watchObservedRunningTime="2026-09-11 12:28:01.267605457 +0000 UTC m=+73.911498113"
Sep 11 12:28:01.278991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.278965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:01.281343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.281325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"image-registry-64bdd5c6bc-dzj2h\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") " pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:01.380220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.380165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:28:01.382602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.382577    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8997d8d1-043e-492b-a884-18a1ecfeb61c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-89nf9\" (UID: \"8997d8d1-043e-492b-a884-18a1ecfeb61c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:28:01.484807 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.484777    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zqm8\""
Sep 11 12:28:01.492315 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.492291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:01.620269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.620234    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-69t66\""
Sep 11 12:28:01.627646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.627610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"
Sep 11 12:28:01.784001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.783974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:28:01.786381 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:01.786353    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f42d09c_1ce8_4ba5_ae07_483ab7ddcd7a.slice/crio-28f0e50950d580964a2ef6c4d8561016132caa17e8429793f5767c3d9ee21f4d WatchSource:0}: Error finding container 28f0e50950d580964a2ef6c4d8561016132caa17e8429793f5767c3d9ee21f4d: Status 404 returned error can't find the container with id 28f0e50950d580964a2ef6c4d8561016132caa17e8429793f5767c3d9ee21f4d
Sep 11 12:28:01.934956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:01.934919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9"]
Sep 11 12:28:01.937686 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:01.937660    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8997d8d1_043e_492b_a884_18a1ecfeb61c.slice/crio-cc4cea56ad42a0db1deb21c79532cbaa7475a161d261fa20aac440b8b4da5b43 WatchSource:0}: Error finding container cc4cea56ad42a0db1deb21c79532cbaa7475a161d261fa20aac440b8b4da5b43: Status 404 returned error can't find the container with id cc4cea56ad42a0db1deb21c79532cbaa7475a161d261fa20aac440b8b4da5b43
Sep 11 12:28:02.250450 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:02.250412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9" event={"ID":"8997d8d1-043e-492b-a884-18a1ecfeb61c","Type":"ContainerStarted","Data":"cc4cea56ad42a0db1deb21c79532cbaa7475a161d261fa20aac440b8b4da5b43"}
Sep 11 12:28:02.252063 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:02.252019    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" event={"ID":"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a","Type":"ContainerStarted","Data":"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"}
Sep 11 12:28:02.252188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:02.252088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" event={"ID":"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a","Type":"ContainerStarted","Data":"28f0e50950d580964a2ef6c4d8561016132caa17e8429793f5767c3d9ee21f4d"}
Sep 11 12:28:02.252398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:02.252370    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:02.276695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:02.276641    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" podStartSLOduration=33.276626671 podStartE2EDuration="33.276626671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:02.27480249 +0000 UTC m=+74.918695144" watchObservedRunningTime="2026-09-11 12:28:02.276626671 +0000 UTC m=+74.920519328"
Sep 11 12:28:03.056303 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.056265    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"]
Sep 11 12:28:03.071364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.071333    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:28:03.071535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.071478    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.077159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 12:28:03.077306 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077130    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 12:28:03.077306 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077179    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 12:28:03.077461 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077444    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 12:28:03.077872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077654    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 12:28:03.077872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.077821    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 12:28:03.078979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.078955    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"]
Sep 11 12:28:03.083771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.083746    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 12:28:03.185507 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.185472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:03.196494 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.196702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.196702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.196702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv4cn\" (UniqueName: \"kubernetes.io/projected/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-kube-api-access-bv4cn\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.196702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.196891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.196716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv4cn\" (UniqueName: \"kubernetes.io/projected/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-kube-api-access-bv4cn\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.298977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.298683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.299731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.299705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.301936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.301867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.301936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.301894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.302147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.302126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-hub\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.302560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.302533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-ca\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.316901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.316823    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv4cn\" (UniqueName: \"kubernetes.io/projected/c9a4bbd4-4687-4a8e-a547-3c7319662eb4-kube-api-access-bv4cn\") pod \"cluster-proxy-proxy-agent-84db688c69-qvkfj\" (UID: \"c9a4bbd4-4687-4a8e-a547-3c7319662eb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.347329 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.347295    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:03.390094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.390051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"
Sep 11 12:28:03.492696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.492646    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:03.637344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.637257    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:03.729492 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.729468    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj"]
Sep 11 12:28:03.730904 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:03.730879    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9a4bbd4_4687_4a8e_a547_3c7319662eb4.slice/crio-775730581d57858a399859043eb6758ada372dc848349e3bbe1cd544825b7bc0 WatchSource:0}: Error finding container 775730581d57858a399859043eb6758ada372dc848349e3bbe1cd544825b7bc0: Status 404 returned error can't find the container with id 775730581d57858a399859043eb6758ada372dc848349e3bbe1cd544825b7bc0
Sep 11 12:28:03.741125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:03.741101    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:04.261383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.261349    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9" event={"ID":"8997d8d1-043e-492b-a884-18a1ecfeb61c","Type":"ContainerStarted","Data":"dec343e73761ff4efa1a5a56965614dfd92e1c13c6473cb0388a65d153395482"}
Sep 11 12:28:04.262628 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.262606    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj" event={"ID":"c9a4bbd4-4687-4a8e-a547-3c7319662eb4","Type":"ContainerStarted","Data":"775730581d57858a399859043eb6758ada372dc848349e3bbe1cd544825b7bc0"}
Sep 11 12:28:04.285516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.285436    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-89nf9" podStartSLOduration=33.763598728 podStartE2EDuration="35.285416164s" totalImagesPullingTime="1.521817436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:04.284783146 +0000 UTC m=+76.928675803" watchObservedRunningTime="2026-09-11 12:28:04.285416164 +0000 UTC m=+76.929308818"
Sep 11 12:28:04.441392 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.441341    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:04.530940 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.530833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:04.638061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.638010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:04.761011 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:04.760972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:06.389288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:06.389232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:07.276022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:07.275986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj" event={"ID":"c9a4bbd4-4687-4a8e-a547-3c7319662eb4","Type":"ContainerStarted","Data":"8ca739735b191ec99e0903e0f9b9222a39942f95b2ae7545f1694c3156c062ea"}
Sep 11 12:28:07.276189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:07.276042    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj" event={"ID":"c9a4bbd4-4687-4a8e-a547-3c7319662eb4","Type":"ContainerStarted","Data":"d8a6063713532f358edd1e5c3f34b2e29bff0f621493d9792aadc6e9a6b9a0be"}
Sep 11 12:28:07.276189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:07.276058    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj" event={"ID":"c9a4bbd4-4687-4a8e-a547-3c7319662eb4","Type":"ContainerStarted","Data":"b540c0646d9bceeee9d2e27a89ee7b5f05b0e09064562769387704dcdd58206c"}
Sep 11 12:28:07.299934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:07.299881    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84db688c69-qvkfj" podStartSLOduration=1.977622787 podStartE2EDuration="5.29986363s" totalImagesPullingTime="3.322240843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:07.299851886 +0000 UTC m=+79.943744542" watchObservedRunningTime="2026-09-11 12:28:07.29986363 +0000 UTC m=+79.943756309"
Sep 11 12:28:08.140327 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.140279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:28:08.142572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.142542    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae144019-341c-4807-8332-29f6161af077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzdjd\" (UID: \"ae144019-341c-4807-8332-29f6161af077\") " pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:28:08.439716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.439632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9m2p7\""
Sep 11 12:28:08.447307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.447281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vzdjd"
Sep 11 12:28:08.711983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.711890    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:08.721666 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.721635    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vzdjd"]
Sep 11 12:28:08.724773 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:08.724724    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae144019_341c_4807_8332_29f6161af077.slice/crio-8354537c66b73c6638ba149c715f4e4cbb1f32cdd9a8f139e9a6c77b34b4a8f8 WatchSource:0}: Error finding container 8354537c66b73c6638ba149c715f4e4cbb1f32cdd9a8f139e9a6c77b34b4a8f8: Status 404 returned error can't find the container with id 8354537c66b73c6638ba149c715f4e4cbb1f32cdd9a8f139e9a6c77b34b4a8f8
Sep 11 12:28:08.808872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:08.808836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:09.068576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:09.068526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:09.284347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:09.284314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzdjd" event={"ID":"ae144019-341c-4807-8332-29f6161af077","Type":"ContainerStarted","Data":"3f137cbe761ba00f75d1983f84ceb2be18361b2576a0683423ca8ca09571290b"}
Sep 11 12:28:09.284710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:09.284369    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzdjd" event={"ID":"ae144019-341c-4807-8332-29f6161af077","Type":"ContainerStarted","Data":"8354537c66b73c6638ba149c715f4e4cbb1f32cdd9a8f139e9a6c77b34b4a8f8"}
Sep 11 12:28:10.825312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:10.825282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:10.980228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:10.980192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:11.254380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:11.254344    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l89gq"
Sep 11 12:28:11.294671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:11.294640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzdjd" event={"ID":"ae144019-341c-4807-8332-29f6161af077","Type":"ContainerStarted","Data":"b0715064a7d5c043562348d1aae2f2efd2c878bf36d91307c7ce1988194fb960"}
Sep 11 12:28:11.413316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:11.413278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:11.514576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:11.514489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:11.601980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:11.601941    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:13.184855 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:13.184805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:13.304453 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:13.304412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzdjd" event={"ID":"ae144019-341c-4807-8332-29f6161af077","Type":"ContainerStarted","Data":"5d323e978ca7c72078551730a649305c9e21294fa105e512a1d76f40e6470194"}
Sep 11 12:28:13.309290 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:13.309237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:13.328356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:13.328308    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vzdjd" podStartSLOduration=33.837718016 podStartE2EDuration="37.328290672s" totalImagesPullingTime="3.490572656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:27:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:13.328209147 +0000 UTC m=+85.972101806" watchObservedRunningTime="2026-09-11 12:28:13.328290672 +0000 UTC m=+85.972183354"
Sep 11 12:28:13.878522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:13.878486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:14.152505 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.152377    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dm2mj"]
Sep 11 12:28:14.155890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.155866    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.159862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.159841    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:28:14.160133 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.160117    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:28:14.160198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.160121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pz2h4\""
Sep 11 12:28:14.160422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.160409    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:28:14.161080 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.161054    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:28:14.161173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.161100    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:28:14.161173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.161129    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:28:14.199875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.199846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:14.285066 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.284998    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-metrics-client-ca\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285066 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-sys\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-textfile\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-accelerators-collector-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-root\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-tls\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-wtmp\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.285431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.285293    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kxm\" (UniqueName: \"kubernetes.io/projected/69712a13-509d-439b-a9f6-43dc2bf30170-kube-api-access-s8kxm\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.303748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.303720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:14.386042 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.385990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386056    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-wtmp\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kxm\" (UniqueName: \"kubernetes.io/projected/69712a13-509d-439b-a9f6-43dc2bf30170-kube-api-access-s8kxm\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-metrics-client-ca\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-sys\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386194    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-textfile\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-accelerators-collector-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-root\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-wtmp\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386545 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-root\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386545 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-tls\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386545 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386447    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69712a13-509d-439b-a9f6-43dc2bf30170-sys\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-metrics-client-ca\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-accelerators-collector-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.386940 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.386921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-textfile\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.388388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.388368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.388760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.388738    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69712a13-509d-439b-a9f6-43dc2bf30170-node-exporter-tls\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.396201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.396180    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kxm\" (UniqueName: \"kubernetes.io/projected/69712a13-509d-439b-a9f6-43dc2bf30170-kube-api-access-s8kxm\") pod \"node-exporter-dm2mj\" (UID: \"69712a13-509d-439b-a9f6-43dc2bf30170\") " pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.464858 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.464788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dm2mj"
Sep 11 12:28:14.477358 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:14.477333    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69712a13_509d_439b_a9f6_43dc2bf30170.slice/crio-e80196973e48ead52d9d141859ce6ce86cfec767d4de545c1e968ad2d2dd55a1 WatchSource:0}: Error finding container e80196973e48ead52d9d141859ce6ce86cfec767d4de545c1e968ad2d2dd55a1: Status 404 returned error can't find the container with id e80196973e48ead52d9d141859ce6ce86cfec767d4de545c1e968ad2d2dd55a1
Sep 11 12:28:14.511924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.511884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:14.642570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.642541    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:14.778607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:14.778575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:15.216559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:15.216464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:15.314440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:15.314406    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dm2mj" event={"ID":"69712a13-509d-439b-a9f6-43dc2bf30170","Type":"ContainerStarted","Data":"e80196973e48ead52d9d141859ce6ce86cfec767d4de545c1e968ad2d2dd55a1"}
Sep 11 12:28:15.324743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:15.324710    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:15.430768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:15.430735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:16.319911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:16.319874    2584 generic.go:356] "Generic (PLEG): container finished" podID="69712a13-509d-439b-a9f6-43dc2bf30170" containerID="c4a701cd932c7fa419afd9d1c162241a72b6aadfd2519067383de45207c52fab" exitCode=0
Sep 11 12:28:16.320299 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:16.319966    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dm2mj" event={"ID":"69712a13-509d-439b-a9f6-43dc2bf30170","Type":"ContainerDied","Data":"c4a701cd932c7fa419afd9d1c162241a72b6aadfd2519067383de45207c52fab"}
Sep 11 12:28:17.271453 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.271417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:17.325617 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.325578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dm2mj" event={"ID":"69712a13-509d-439b-a9f6-43dc2bf30170","Type":"ContainerStarted","Data":"393eaea1ae62589596bd75b4b6cde985cc36ee01c31ab47f4bacaf30d9bcd8c2"}
Sep 11 12:28:17.326105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.325662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dm2mj" event={"ID":"69712a13-509d-439b-a9f6-43dc2bf30170","Type":"ContainerStarted","Data":"11c5b79d0af02c018eb2ee645b0d3caed288693754b3afcdd3359519d644fca4"}
Sep 11 12:28:17.356328 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.356272    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dm2mj" podStartSLOduration=2.383404343 podStartE2EDuration="3.356255876s" totalImagesPullingTime="910.756912ms" totalInitContainerRuntime="62.094621ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:17.354549091 +0000 UTC m=+89.998441746" watchObservedRunningTime="2026-09-11 12:28:17.356255876 +0000 UTC m=+90.000148533"
Sep 11 12:28:17.383046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.382988    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:17.482193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.482157    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:17.586160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:17.586071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:18.913707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:18.913672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:19.169699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:19.169607    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:19.918926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:19.918886    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:20.016810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:20.016771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:20.502720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:20.502656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:20.585102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:20.585068    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:20.880451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:20.880361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:20.979449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:20.979418    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:24.269745 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:24.269711    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:27.157671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:27.157623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:27.259814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:27.259782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:29.280536 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.280481    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" podUID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" containerName="registry" containerID="cri-o://165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61" gracePeriod=30
Sep 11 12:28:29.512944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.512867    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:29.667109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.667014    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-7ndqx"]
Sep 11 12:28:29.667285 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.667273    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" containerName="registry"
Sep 11 12:28:29.667334 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.667287    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" containerName="registry"
Sep 11 12:28:29.667368 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.667349    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" containerName="registry"
Sep 11 12:28:29.670408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.670392    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:29.674177 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.674157    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kt2lz\""
Sep 11 12:28:29.674541 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.674519    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 12:28:29.674703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.674689    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 12:28:29.685197 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.685170    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:29.686155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.686133    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7ndqx"]
Sep 11 12:28:29.695930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.695910    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.695938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.695960    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.695984    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696133    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696190    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57lfc\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696226    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696305    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets\") pod \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\" (UID: \"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a\") "
Sep 11 12:28:29.696495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696471    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:28:29.696622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.696589    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:28:29.698664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.698615    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:29.698822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.698798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:28:29.698910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.698884    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc" (OuterVolumeSpecName: "kube-api-access-57lfc") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "kube-api-access-57lfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:29.698953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.698920    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:28:29.698953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.698938    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:29.705115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.705095    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" (UID: "4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:28:29.797000 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.796961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmbf\" (UniqueName: \"kubernetes.io/projected/3d91683a-6f12-410f-8ced-0544c779b5f3-kube-api-access-njmbf\") pod \"downloads-76f99584f4-7ndqx\" (UID: \"3d91683a-6f12-410f-8ced-0544c779b5f3\") " pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797044    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-bound-sa-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797060    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-trusted-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797071    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-ca-trust-extracted\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797081    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797089    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-registry-certificates\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797099    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57lfc\" (UniqueName: \"kubernetes.io/projected/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-kube-api-access-57lfc\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797108    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-image-registry-private-configuration\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.797181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.797117    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a-installation-pull-secrets\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:28:29.898230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.898193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmbf\" (UniqueName: \"kubernetes.io/projected/3d91683a-6f12-410f-8ced-0544c779b5f3-kube-api-access-njmbf\") pod \"downloads-76f99584f4-7ndqx\" (UID: \"3d91683a-6f12-410f-8ced-0544c779b5f3\") " pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:29.907177 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.907155    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmbf\" (UniqueName: \"kubernetes.io/projected/3d91683a-6f12-410f-8ced-0544c779b5f3-kube-api-access-njmbf\") pod \"downloads-76f99584f4-7ndqx\" (UID: \"3d91683a-6f12-410f-8ced-0544c779b5f3\") " pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:29.979094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:29.978985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:30.241875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.241845    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rjjj9"
Sep 11 12:28:30.256895 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.256874    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7ndqx"]
Sep 11 12:28:30.259572 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:30.259531    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d91683a_6f12_410f_8ced_0544c779b5f3.slice/crio-5bffd3c04ceddee31e4e15f9f2637ea44c0ab8947fa035e94bb373dc2b622605 WatchSource:0}: Error finding container 5bffd3c04ceddee31e4e15f9f2637ea44c0ab8947fa035e94bb373dc2b622605: Status 404 returned error can't find the container with id 5bffd3c04ceddee31e4e15f9f2637ea44c0ab8947fa035e94bb373dc2b622605
Sep 11 12:28:30.368658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.368618    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7ndqx" event={"ID":"3d91683a-6f12-410f-8ced-0544c779b5f3","Type":"ContainerStarted","Data":"5bffd3c04ceddee31e4e15f9f2637ea44c0ab8947fa035e94bb373dc2b622605"}
Sep 11 12:28:30.369899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.369876    2584 generic.go:356] "Generic (PLEG): container finished" podID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" containerID="165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61" exitCode=0
Sep 11 12:28:30.370014 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.369911    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" event={"ID":"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a","Type":"ContainerDied","Data":"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"}
Sep 11 12:28:30.370014 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.369933    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"
Sep 11 12:28:30.370014 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.369949    2584 scope.go:117] "RemoveContainer" containerID="165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"
Sep 11 12:28:30.370200 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.369939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bdd5c6bc-dzj2h" event={"ID":"4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a","Type":"ContainerDied","Data":"28f0e50950d580964a2ef6c4d8561016132caa17e8429793f5767c3d9ee21f4d"}
Sep 11 12:28:30.378185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.378168    2584 scope.go:117] "RemoveContainer" containerID="165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"
Sep 11 12:28:30.378481 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:28:30.378455    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61\": container with ID starting with 165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61 not found: ID does not exist" containerID="165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"
Sep 11 12:28:30.378529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.378494    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61"} err="failed to get container status \"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61\": rpc error: code = NotFound desc = could not find container \"165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61\": container with ID starting with 165ed821fb3e6bbdef31a01c341c62e2bd25dfea9b75a021902ddca74bfade61 not found: ID does not exist"
Sep 11 12:28:30.390784 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.390759    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:28:30.393044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:30.393006    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64bdd5c6bc-dzj2h"]
Sep 11 12:28:31.491104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:31.491058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:31.589516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:31.589444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:31.769147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:31.769065    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:31.877239 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:31.877206    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a" path="/var/lib/kubelet/pods/4f42d09c-1ce8-4ba5-ae07-483ab7ddcd7a/volumes"
Sep 11 12:28:32.030374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:32.030269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:32.605369 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:32.605336    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:32.706572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:32.706531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:33.211687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:33.211642    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:33.291239 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:33.291203    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:38.579272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:38.579183    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:38.679112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:38.679077    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:39.460302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:39.460216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:39.556523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:39.556490    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:40.199390 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.199357    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:28:40.201618 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.201597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.204364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.204342    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 12:28:40.205635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.205574    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 12:28:40.205635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.205574    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 12:28:40.205635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.205615    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 12:28:40.206678 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.206643    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 12:28:40.211544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.211277    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xq7vq\""
Sep 11 12:28:40.214801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.214778    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:28:40.283982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.283940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.283982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.283984    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.284259 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.284010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.284259 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.284205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.284362 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.284270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.284418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.284378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8mw\" (UniqueName: \"kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.384890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.384855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.384914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.384940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.384993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8mw\" (UniqueName: \"kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.385054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.385075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.385771    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.385866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.385936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.385912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.388071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.388013    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.388196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.388150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.396736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.396710    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8mw\" (UniqueName: \"kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw\") pod \"console-68ff95b7b9-5f45j\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") " pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.514676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.514625    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:28:40.977108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:40.977002    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:41.077225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:41.077187    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:45.006001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:45.005941    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:45.104579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:45.104531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:45.394398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:45.394313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:45.495364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:45.495325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:46.437694 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.437662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7ndqx" event={"ID":"3d91683a-6f12-410f-8ced-0544c779b5f3","Type":"ContainerStarted","Data":"9bbe85f70e3a741da4581d36d6d08b6e46c89389d5f9a1c033cb9aa29048eaa3"}
Sep 11 12:28:46.438133 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.437891    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:46.439508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.439471    2584 patch_prober.go:28] interesting pod/downloads-76f99584f4-7ndqx container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body=
Sep 11 12:28:46.439636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.439538    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-7ndqx" podUID="3d91683a-6f12-410f-8ced-0544c779b5f3" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 11 12:28:46.459902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.459831    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-7ndqx" podStartSLOduration=1.429379243 podStartE2EDuration="17.459811664s" totalImagesPullingTime="16.030432421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:46.457554164 +0000 UTC m=+119.101446824" watchObservedRunningTime="2026-09-11 12:28:46.459811664 +0000 UTC m=+119.103704377"
Sep 11 12:28:46.489698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:46.489589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:28:46.492395 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:46.492354    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec9b8f5_edbe_49f4_bedd_f2603767eb99.slice/crio-743088094e7033a88104d32850da5f0145549b813733936719935113b2501b3a WatchSource:0}: Error finding container 743088094e7033a88104d32850da5f0145549b813733936719935113b2501b3a: Status 404 returned error can't find the container with id 743088094e7033a88104d32850da5f0145549b813733936719935113b2501b3a
Sep 11 12:28:47.445806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:47.445710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ff95b7b9-5f45j" event={"ID":"9ec9b8f5-edbe-49f4-bedd-f2603767eb99","Type":"ContainerStarted","Data":"743088094e7033a88104d32850da5f0145549b813733936719935113b2501b3a"}
Sep 11 12:28:47.456896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:47.456830    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-7ndqx"
Sep 11 12:28:49.779870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.779813    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:49.879514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.879475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:49.969242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.969203    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:28:49.991419 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.990714    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:28:49.991419 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.990890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:49.999978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:49.999943    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 12:28:50.069485 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069485 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069457    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.069707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.069660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv62g\" (UniqueName: \"kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170755 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv62g\" (UniqueName: \"kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.170936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.171223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.170963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.171874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.171817    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.171874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.171860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.172104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.172084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.172571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.172551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.173754 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.173722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.173938 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.173921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.183400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.183380    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv62g\" (UniqueName: \"kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g\") pod \"console-66bf8fcb4-2bqs2\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") " pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.304094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.304052    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:28:50.608918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:50.608800    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:28:50.614131 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:28:50.614101    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2769929_f3b3_4267_affb_76808c75b9f6.slice/crio-532dac70ca2b31403ecdcc3b70b03bc21e277a6df459f8cc93a13ab1a4d3bf1d WatchSource:0}: Error finding container 532dac70ca2b31403ecdcc3b70b03bc21e277a6df459f8cc93a13ab1a4d3bf1d: Status 404 returned error can't find the container with id 532dac70ca2b31403ecdcc3b70b03bc21e277a6df459f8cc93a13ab1a4d3bf1d
Sep 11 12:28:51.468709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.468665    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ff95b7b9-5f45j" event={"ID":"9ec9b8f5-edbe-49f4-bedd-f2603767eb99","Type":"ContainerStarted","Data":"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"}
Sep 11 12:28:51.470734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.470696    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf8fcb4-2bqs2" event={"ID":"a2769929-f3b3-4267-affb-76808c75b9f6","Type":"ContainerStarted","Data":"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"}
Sep 11 12:28:51.470878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.470746    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf8fcb4-2bqs2" event={"ID":"a2769929-f3b3-4267-affb-76808c75b9f6","Type":"ContainerStarted","Data":"532dac70ca2b31403ecdcc3b70b03bc21e277a6df459f8cc93a13ab1a4d3bf1d"}
Sep 11 12:28:51.491359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.491306    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68ff95b7b9-5f45j" podStartSLOduration=7.647155411 podStartE2EDuration="11.491283819s" totalImagesPullingTime="3.844128408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:51.490002992 +0000 UTC m=+124.133895651" watchObservedRunningTime="2026-09-11 12:28:51.491283819 +0000 UTC m=+124.135176478"
Sep 11 12:28:51.509112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.509059    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bf8fcb4-2bqs2" podStartSLOduration=2.509042314 podStartE2EDuration="2.509042314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:51.508566583 +0000 UTC m=+124.152459240" watchObservedRunningTime="2026-09-11 12:28:51.509042314 +0000 UTC m=+124.152934962"
Sep 11 12:28:51.787269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.787232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:51.888102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:51.888022    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:54.579400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:54.579359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:54.680400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:54.680357    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:55.489754 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:55.489718    2584 generic.go:356] "Generic (PLEG): container finished" podID="1b3f976d-9792-4e0b-86a2-2389fbb41ebc" containerID="063e7ac9c1f29af6a747c7cd974f39537bb7324fedcaee9e5a24649ce3004615" exitCode=0
Sep 11 12:28:55.489935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:55.489795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5cb65" event={"ID":"1b3f976d-9792-4e0b-86a2-2389fbb41ebc","Type":"ContainerDied","Data":"063e7ac9c1f29af6a747c7cd974f39537bb7324fedcaee9e5a24649ce3004615"}
Sep 11 12:28:55.490309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:55.490285    2584 scope.go:117] "RemoveContainer" containerID="063e7ac9c1f29af6a747c7cd974f39537bb7324fedcaee9e5a24649ce3004615"
Sep 11 12:28:56.495626 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:56.495588    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5cb65" event={"ID":"1b3f976d-9792-4e0b-86a2-2389fbb41ebc","Type":"ContainerStarted","Data":"0abcfdf19cd07ab5042632171556c318cfff1ad75892c9f415e6b9eed6d3ac18"}
Sep 11 12:28:59.798241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:59.798210    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/init-textfile/0.log"
Sep 11 12:28:59.823098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:59.823057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:28:59.921011 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:28:59.920969    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:00.001460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.001428    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/node-exporter/0.log"
Sep 11 12:29:00.020941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.020902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:00.087987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.087909    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:00.199146 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.199117    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/kube-rbac-proxy/0.log"
Sep 11 12:29:00.305157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.305119    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:29:00.305355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.305180    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:29:00.310125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.310099    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:29:00.512753 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.512716    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:29:00.514964 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.514942    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:00.515055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.514992    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:00.519434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.519412    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:00.570466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.570435    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:29:00.828665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.828581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:00.929869 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:00.929836    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:01.018511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:01.018475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:01.513837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:01.513801    2584 generic.go:356] "Generic (PLEG): container finished" podID="b116c624-3915-473b-8932-70a802b8527d" containerID="084f9512b12dd1e504e7d7022d7f7deca0ed0f4f7b32a71bca280ca90ff056fd" exitCode=0
Sep 11 12:29:01.513988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:01.513873    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll" event={"ID":"b116c624-3915-473b-8932-70a802b8527d","Type":"ContainerDied","Data":"084f9512b12dd1e504e7d7022d7f7deca0ed0f4f7b32a71bca280ca90ff056fd"}
Sep 11 12:29:01.514437 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:01.514406    2584 scope.go:117] "RemoveContainer" containerID="084f9512b12dd1e504e7d7022d7f7deca0ed0f4f7b32a71bca280ca90ff056fd"
Sep 11 12:29:01.518179 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:01.518158    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:02.038808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:02.038771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:02.519906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:02.519868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-q5dll" event={"ID":"b116c624-3915-473b-8932-70a802b8527d","Type":"ContainerStarted","Data":"34c532d2c2b1a3f421f9a82eebfd1f3bf922540aa372741e09d1340a2ad5162a"}
Sep 11 12:29:05.399616 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:05.399581    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-89nf9_8997d8d1-043e-492b-a884-18a1ecfeb61c/networking-console-plugin/0.log"
Sep 11 12:29:06.000740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:06.000712    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66bf8fcb4-2bqs2_a2769929-f3b3-4267-affb-76808c75b9f6/console/0.log"
Sep 11 12:29:06.200058 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:06.200008    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68ff95b7b9-5f45j_9ec9b8f5-edbe-49f4-bedd-f2603767eb99/console/0.log"
Sep 11 12:29:06.401430 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:06.401349    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-7ndqx_3d91683a-6f12-410f-8ced-0544c779b5f3/download-server/0.log"
Sep 11 12:29:07.187182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:07.187141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:07.198476 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:07.198448    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw6mm_bb6265ee-2d15-43e6-b7e4-e0e28eb01388/serve-healthcheck-canary/0.log"
Sep 11 12:29:07.284840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:07.284805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:07.345442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:07.345402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:15.010952 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:15.010918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:15.111714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:15.111679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:26.796793 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:26.796754    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:26.879452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:26.879420    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:27.538462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.538419    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68ff95b7b9-5f45j" podUID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" containerName="console" containerID="cri-o://1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5" gracePeriod=15
Sep 11 12:29:27.816254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.816184    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:27.873780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.873976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873803    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.873976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873887    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.873976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873912    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr8mw\" (UniqueName: \"kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.873976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.874224 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.873979    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert\") pod \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\" (UID: \"9ec9b8f5-edbe-49f4-bedd-f2603767eb99\") "
Sep 11 12:29:27.874431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.874396    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config" (OuterVolumeSpecName: "console-config") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:27.874590 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.874465    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:27.874898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.874874    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:27.876716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.876685    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:27.876716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.876707    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:27.876849 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.876744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw" (OuterVolumeSpecName: "kube-api-access-pr8mw") pod "9ec9b8f5-edbe-49f4-bedd-f2603767eb99" (UID: "9ec9b8f5-edbe-49f4-bedd-f2603767eb99"). InnerVolumeSpecName "kube-api-access-pr8mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:29:27.974720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974679    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-oauth-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:27.974720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974712    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:27.974720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974721    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:27.974720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974734    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-console-oauth-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:27.974982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974744    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr8mw\" (UniqueName: \"kubernetes.io/projected/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-kube-api-access-pr8mw\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:27.974982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:27.974753    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec9b8f5-edbe-49f4-bedd-f2603767eb99-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:29:28.624878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.624843    2584 generic.go:356] "Generic (PLEG): container finished" podID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" containerID="1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5" exitCode=0
Sep 11 12:29:28.625075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.624895    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68ff95b7b9-5f45j"
Sep 11 12:29:28.625075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.624937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ff95b7b9-5f45j" event={"ID":"9ec9b8f5-edbe-49f4-bedd-f2603767eb99","Type":"ContainerDied","Data":"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"}
Sep 11 12:29:28.625075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.625008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68ff95b7b9-5f45j" event={"ID":"9ec9b8f5-edbe-49f4-bedd-f2603767eb99","Type":"ContainerDied","Data":"743088094e7033a88104d32850da5f0145549b813733936719935113b2501b3a"}
Sep 11 12:29:28.625075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.625043    2584 scope.go:117] "RemoveContainer" containerID="1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"
Sep 11 12:29:28.633478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.633460    2584 scope.go:117] "RemoveContainer" containerID="1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"
Sep 11 12:29:28.633747 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:29:28.633729    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5\": container with ID starting with 1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5 not found: ID does not exist" containerID="1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"
Sep 11 12:29:28.633813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.633759    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5"} err="failed to get container status \"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5\": rpc error: code = NotFound desc = could not find container \"1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5\": container with ID starting with 1e7511bbe6d8b44a6203e24521dba6a250a35cbd1563719008c027b7ec1efda5 not found: ID does not exist"
Sep 11 12:29:28.646542 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.646517    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:29:28.654806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:28.654782    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68ff95b7b9-5f45j"]
Sep 11 12:29:29.875562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:29.875529    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" path="/var/lib/kubelet/pods/9ec9b8f5-edbe-49f4-bedd-f2603767eb99/volumes"
Sep 11 12:29:33.573547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:33.573509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:33.868332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:33.868237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:38.660364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.660329    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-857476fcf9-fknx4"]
Sep 11 12:29:38.660751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.660598    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" containerName="console"
Sep 11 12:29:38.660751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.660610    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" containerName="console"
Sep 11 12:29:38.660751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.660665    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec9b8f5-edbe-49f4-bedd-f2603767eb99" containerName="console"
Sep 11 12:29:38.663180 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.663163    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.667792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.667768    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 12:29:38.667792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.667784    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 12:29:38.668317 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.668300    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 12:29:38.668410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.668334    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 12:29:38.668410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.668350    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5znk8\""
Sep 11 12:29:38.668643 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.668627    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 12:29:38.674590 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.674572    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 12:29:38.687884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.687864    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-857476fcf9-fknx4"]
Sep 11 12:29:38.753182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753141    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-metrics-client-ca\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753196    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-federate-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdnw\" (UniqueName: \"kubernetes.io/projected/6c51f7ed-b168-4792-b0a7-18879d202de9-kube-api-access-2hdnw\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.753470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.753366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-serving-certs-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.853926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.853897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.853935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.853955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-serving-certs-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-metrics-client-ca\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-federate-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdnw\" (UniqueName: \"kubernetes.io/projected/6c51f7ed-b168-4792-b0a7-18879d202de9-kube-api-access-2hdnw\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-metrics-client-ca\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.854944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854932    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-serving-certs-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.855109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.854959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.857130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.857098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-telemeter-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.857219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.857149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.857219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.857164    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-federate-client-tls\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.857219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.857178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c51f7ed-b168-4792-b0a7-18879d202de9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.864873 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.864850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdnw\" (UniqueName: \"kubernetes.io/projected/6c51f7ed-b168-4792-b0a7-18879d202de9-kube-api-access-2hdnw\") pod \"telemeter-client-857476fcf9-fknx4\" (UID: \"6c51f7ed-b168-4792-b0a7-18879d202de9\") " pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:38.972620 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:38.972551    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4"
Sep 11 12:29:39.248137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:39.248105    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-857476fcf9-fknx4"]
Sep 11 12:29:39.251803 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:29:39.251775    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c51f7ed_b168_4792_b0a7_18879d202de9.slice/crio-4093453a8b161aa557b00b88a6c3cfa3c4c1933833efc327bae673889b0e7532 WatchSource:0}: Error finding container 4093453a8b161aa557b00b88a6c3cfa3c4c1933833efc327bae673889b0e7532: Status 404 returned error can't find the container with id 4093453a8b161aa557b00b88a6c3cfa3c4c1933833efc327bae673889b0e7532
Sep 11 12:29:39.666212 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:39.666122    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4" event={"ID":"6c51f7ed-b168-4792-b0a7-18879d202de9","Type":"ContainerStarted","Data":"4093453a8b161aa557b00b88a6c3cfa3c4c1933833efc327bae673889b0e7532"}
Sep 11 12:29:41.132707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:41.132671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:41.677361 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:41.677320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4" event={"ID":"6c51f7ed-b168-4792-b0a7-18879d202de9","Type":"ContainerStarted","Data":"1af306d5f51e026a25ba8de45f1a4016b3cc3bd73332e11d711099af7d9f5f02"}
Sep 11 12:29:42.682929 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.682893    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4" event={"ID":"6c51f7ed-b168-4792-b0a7-18879d202de9","Type":"ContainerStarted","Data":"f947b83d20f99edded8e2e3bcf8cce2cef076ad04a5b91bb763028ef44386d94"}
Sep 11 12:29:42.683347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.682953    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4" event={"ID":"6c51f7ed-b168-4792-b0a7-18879d202de9","Type":"ContainerStarted","Data":"300f1cf7cd4e76b08c9dcdd18e746b99f401db4274119f499b12c421d6cdc96a"}
Sep 11 12:29:42.710879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.710827    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-857476fcf9-fknx4" podStartSLOduration=1.9149104750000001 podStartE2EDuration="4.710804681s" totalImagesPullingTime="2.795894206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:29:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:29:42.709820525 +0000 UTC m=+175.353713172" watchObservedRunningTime="2026-09-11 12:29:42.710804681 +0000 UTC m=+175.354697351"
Sep 11 12:29:42.823946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.823913    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:29:42.826243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.826225    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.847150 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.847111    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:29:42.884117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.884080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:42.886083 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886064    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886143 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886106    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886143 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886148    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886190    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.886344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.886249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4h45\" (UniqueName: \"kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.958483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.958398    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:42.987452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4h45\" (UniqueName: \"kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.987644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.987592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.988300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.988271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.988409 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.988386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.988486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.988441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.988652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.988631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.990142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.990118    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.990273 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.990259    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:42.997544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:42.997525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4h45\" (UniqueName: \"kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45\") pod \"console-7cf68784f9-rvz86\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") " pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:43.134717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:43.134679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:43.406962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:43.406938    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:29:43.408242 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:29:43.408209    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ee0fbd_2391_4cb3_936e_96d531bcae76.slice/crio-2ed72d17fd170c7a934cf88d718e5f7a90129fa912e1ba8ef63aa555328b940b WatchSource:0}: Error finding container 2ed72d17fd170c7a934cf88d718e5f7a90129fa912e1ba8ef63aa555328b940b: Status 404 returned error can't find the container with id 2ed72d17fd170c7a934cf88d718e5f7a90129fa912e1ba8ef63aa555328b940b
Sep 11 12:29:43.688380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:43.688287    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf68784f9-rvz86" event={"ID":"08ee0fbd-2391-4cb3-936e-96d531bcae76","Type":"ContainerStarted","Data":"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"}
Sep 11 12:29:43.688380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:43.688344    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf68784f9-rvz86" event={"ID":"08ee0fbd-2391-4cb3-936e-96d531bcae76","Type":"ContainerStarted","Data":"2ed72d17fd170c7a934cf88d718e5f7a90129fa912e1ba8ef63aa555328b940b"}
Sep 11 12:29:43.708268 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:43.708221    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cf68784f9-rvz86" podStartSLOduration=1.708204821 podStartE2EDuration="1.708204821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:29:43.707233831 +0000 UTC m=+176.351126489" watchObservedRunningTime="2026-09-11 12:29:43.708204821 +0000 UTC m=+176.352097523"
Sep 11 12:29:53.135156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.135115    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:53.135625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.135179    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:53.141190 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.141163    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:53.732286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.732256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:29:53.783354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.783323    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:29:53.893171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.893119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:53.994867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:53.994762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:29:54.058902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:29:54.058868    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:18.803192 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:18.803147    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66bf8fcb4-2bqs2" podUID="a2769929-f3b3-4267-affb-76808c75b9f6" containerName="console" containerID="cri-o://c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317" gracePeriod=15
Sep 11 12:30:19.035933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.035906    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:30:19.175972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.175874    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.175972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.175919    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.175972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.175946    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv62g\" (UniqueName: \"kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.176282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176016    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.176282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176062    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.176282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176102    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.176282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176138    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle\") pod \"a2769929-f3b3-4267-affb-76808c75b9f6\" (UID: \"a2769929-f3b3-4267-affb-76808c75b9f6\") "
Sep 11 12:30:19.176471 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176423    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config" (OuterVolumeSpecName: "console-config") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:30:19.176617 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176585    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:30:19.176704 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176607    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:30:19.176760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.176738    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:30:19.178159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.178128    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:30:19.178272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.178230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:30:19.178272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.178234    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g" (OuterVolumeSpecName: "kube-api-access-lv62g") pod "a2769929-f3b3-4267-affb-76808c75b9f6" (UID: "a2769929-f3b3-4267-affb-76808c75b9f6"). InnerVolumeSpecName "kube-api-access-lv62g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:30:19.277579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277538    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-trusted-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277570    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277583    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-console-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277593    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv62g\" (UniqueName: \"kubernetes.io/projected/a2769929-f3b3-4267-affb-76808c75b9f6-kube-api-access-lv62g\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277602    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-oauth-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277611    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2769929-f3b3-4267-affb-76808c75b9f6-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.277822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.277618    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2769929-f3b3-4267-affb-76808c75b9f6-console-oauth-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:30:19.831806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.831769    2584 generic.go:356] "Generic (PLEG): container finished" podID="a2769929-f3b3-4267-affb-76808c75b9f6" containerID="c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317" exitCode=0
Sep 11 12:30:19.832267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.831821    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf8fcb4-2bqs2"
Sep 11 12:30:19.832267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.831836    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf8fcb4-2bqs2" event={"ID":"a2769929-f3b3-4267-affb-76808c75b9f6","Type":"ContainerDied","Data":"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"}
Sep 11 12:30:19.832267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.831898    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf8fcb4-2bqs2" event={"ID":"a2769929-f3b3-4267-affb-76808c75b9f6","Type":"ContainerDied","Data":"532dac70ca2b31403ecdcc3b70b03bc21e277a6df459f8cc93a13ab1a4d3bf1d"}
Sep 11 12:30:19.832267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.831923    2584 scope.go:117] "RemoveContainer" containerID="c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"
Sep 11 12:30:19.840694 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.840671    2584 scope.go:117] "RemoveContainer" containerID="c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"
Sep 11 12:30:19.840952 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:30:19.840933    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317\": container with ID starting with c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317 not found: ID does not exist" containerID="c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"
Sep 11 12:30:19.841003 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.840960    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317"} err="failed to get container status \"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317\": rpc error: code = NotFound desc = could not find container \"c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317\": container with ID starting with c7336dcf8b44f5c8a39ce29c715ee5f52d964c6610499677560282043b611317 not found: ID does not exist"
Sep 11 12:30:19.854079 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.854049    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:30:19.856318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.856298    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66bf8fcb4-2bqs2"]
Sep 11 12:30:19.875607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:19.875582    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2769929-f3b3-4267-affb-76808c75b9f6" path="/var/lib/kubelet/pods/a2769929-f3b3-4267-affb-76808c75b9f6/volumes"
Sep 11 12:30:26.554938 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:26.554885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:26.622515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:26.622480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:48.848779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:48.848739    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:48.936365 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:48.936329    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:53.296487 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.296454    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:30:53.296924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.296713    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2769929-f3b3-4267-affb-76808c75b9f6" containerName="console"
Sep 11 12:30:53.296924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.296726    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2769929-f3b3-4267-affb-76808c75b9f6" containerName="console"
Sep 11 12:30:53.296924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.296789    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2769929-f3b3-4267-affb-76808c75b9f6" containerName="console"
Sep 11 12:30:53.300699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.300680    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.318797 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.318769    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:30:53.350538 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.350507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:53.415152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415168    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415234    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:30:53.415462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415408    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbh4\" (UniqueName: \"kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.415594 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.415488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516421 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516461    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbh4\" (UniqueName: \"kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.516799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.516573    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.517312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.517285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.517431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.517319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.517431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.517363    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.517512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.517479    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.519105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.519085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.519176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.519154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.526821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.526800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbh4\" (UniqueName: \"kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4\") pod \"console-798d5554dd-9wg8c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") " pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.609418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.609318    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:30:53.885581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.885517    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:30:53.887715 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:30:53.887692    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092c4718_3e73_4606_9522_acc348e02d4c.slice/crio-5af5021307d21a55567a817b42146bfc6c2f8326382eec6d42962f5fdda1e089 WatchSource:0}: Error finding container 5af5021307d21a55567a817b42146bfc6c2f8326382eec6d42962f5fdda1e089: Status 404 returned error can't find the container with id 5af5021307d21a55567a817b42146bfc6c2f8326382eec6d42962f5fdda1e089
Sep 11 12:30:53.952056 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.952008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798d5554dd-9wg8c" event={"ID":"092c4718-3e73-4606-9522-acc348e02d4c","Type":"ContainerStarted","Data":"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"}
Sep 11 12:30:53.952166 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.952080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798d5554dd-9wg8c" event={"ID":"092c4718-3e73-4606-9522-acc348e02d4c","Type":"ContainerStarted","Data":"5af5021307d21a55567a817b42146bfc6c2f8326382eec6d42962f5fdda1e089"}
Sep 11 12:30:53.973623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:30:53.973567    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798d5554dd-9wg8c" podStartSLOduration=0.973548151 podStartE2EDuration="973.548151ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:30:53.971349759 +0000 UTC m=+246.615242417" watchObservedRunningTime="2026-09-11 12:30:53.973548151 +0000 UTC m=+246.617440810"
Sep 11 12:31:00.785717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:00.785677    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:00.844193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:00.844159    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:03.610130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:03.610076    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:31:03.610130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:03.610141    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:31:03.614951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:03.614929    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:31:03.991457 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:03.991428    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:31:04.089085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:04.089050    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:31:04.212697 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:04.212646    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:04.313979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:04.313885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:04.414226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:04.414194    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:15.037145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:15.037057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:15.136466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:15.136428    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:29.108070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.108014    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cf68784f9-rvz86" podUID="08ee0fbd-2391-4cb3-936e-96d531bcae76" containerName="console" containerID="cri-o://f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6" gracePeriod=15
Sep 11 12:31:29.347381 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.347355    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:31:29.509348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509310    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509357    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509376    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509396    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509518    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509576    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4h45\" (UniqueName: \"kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509616    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert\") pod \"08ee0fbd-2391-4cb3-936e-96d531bcae76\" (UID: \"08ee0fbd-2391-4cb3-936e-96d531bcae76\") "
Sep 11 12:31:29.509848 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config" (OuterVolumeSpecName: "console-config") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:31:29.509906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509877    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:31:29.509958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509889    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.509958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.509926    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:31:29.510146 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.510124    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca" (OuterVolumeSpecName: "service-ca") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:31:29.511543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.511514    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:31:29.511682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.511664    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45" (OuterVolumeSpecName: "kube-api-access-x4h45") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "kube-api-access-x4h45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:31:29.511740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.511672    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08ee0fbd-2391-4cb3-936e-96d531bcae76" (UID: "08ee0fbd-2391-4cb3-936e-96d531bcae76"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:31:29.610326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610286    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-oauth-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.610326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610318    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-trusted-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.610326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610328    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.610326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610337    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ee0fbd-2391-4cb3-936e-96d531bcae76-oauth-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.610582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610345    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4h45\" (UniqueName: \"kubernetes.io/projected/08ee0fbd-2391-4cb3-936e-96d531bcae76-kube-api-access-x4h45\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:29.610582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:29.610354    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ee0fbd-2391-4cb3-936e-96d531bcae76-console-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:31:30.082272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.082229    2584 generic.go:356] "Generic (PLEG): container finished" podID="08ee0fbd-2391-4cb3-936e-96d531bcae76" containerID="f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6" exitCode=0
Sep 11 12:31:30.082449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.082288    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf68784f9-rvz86"
Sep 11 12:31:30.082449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.082291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf68784f9-rvz86" event={"ID":"08ee0fbd-2391-4cb3-936e-96d531bcae76","Type":"ContainerDied","Data":"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"}
Sep 11 12:31:30.082449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.082404    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf68784f9-rvz86" event={"ID":"08ee0fbd-2391-4cb3-936e-96d531bcae76","Type":"ContainerDied","Data":"2ed72d17fd170c7a934cf88d718e5f7a90129fa912e1ba8ef63aa555328b940b"}
Sep 11 12:31:30.082449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.082429    2584 scope.go:117] "RemoveContainer" containerID="f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"
Sep 11 12:31:30.090122 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.090104    2584 scope.go:117] "RemoveContainer" containerID="f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"
Sep 11 12:31:30.090368 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:31:30.090349    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6\": container with ID starting with f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6 not found: ID does not exist" containerID="f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"
Sep 11 12:31:30.090441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.090381    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6"} err="failed to get container status \"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6\": rpc error: code = NotFound desc = could not find container \"f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6\": container with ID starting with f0dd2911b970c8f39c47fedee6f669cc85a35bbe5c00773ab8eecfe7d71a5da6 not found: ID does not exist"
Sep 11 12:31:30.100272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.100250    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:31:30.102644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:30.102622    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cf68784f9-rvz86"]
Sep 11 12:31:31.875676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:31.875645    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08ee0fbd-2391-4cb3-936e-96d531bcae76" path="/var/lib/kubelet/pods/08ee0fbd-2391-4cb3-936e-96d531bcae76/volumes"
Sep 11 12:31:47.791944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:47.791916    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 12:31:50.593171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:50.593129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:51.468291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.468258    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"]
Sep 11 12:31:51.468529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.468518    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08ee0fbd-2391-4cb3-936e-96d531bcae76" containerName="console"
Sep 11 12:31:51.468576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.468531    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="08ee0fbd-2391-4cb3-936e-96d531bcae76" containerName="console"
Sep 11 12:31:51.468610 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.468580    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="08ee0fbd-2391-4cb3-936e-96d531bcae76" containerName="console"
Sep 11 12:31:51.471442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.471425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.474611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.474561    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:31:51.474611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.474604    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:31:51.475738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.475722    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ks7w8\""
Sep 11 12:31:51.482015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.481994    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"]
Sep 11 12:31:51.568418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.568381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.568418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.568419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.568619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.568538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtp9\" (UniqueName: \"kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.669345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.669307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtp9\" (UniqueName: \"kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.669345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.669351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.669767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.669369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.669767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.669674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.669767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.669705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.679329 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.679304    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtp9\" (UniqueName: \"kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:51.780403 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:51.780369    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:31:52.051386 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:52.051292    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"]
Sep 11 12:31:52.054096 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:31:52.054067    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff58e88_9c5d_40cb_89c3_ef50464a40ea.slice/crio-2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f WatchSource:0}: Error finding container 2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f: Status 404 returned error can't find the container with id 2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f
Sep 11 12:31:52.056152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:52.056135    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:31:52.103054 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:52.102999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:52.161589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:52.161552    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerStarted","Data":"2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f"}
Sep 11 12:31:55.768736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:55.768702    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:31:59.190324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:59.190285    2584 generic.go:356] "Generic (PLEG): container finished" podID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerID="14a55dd24286bc73ad58bf7f5bccaadb5ff68963dcc87209a493b44589341182" exitCode=0
Sep 11 12:31:59.190837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:31:59.190375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerDied","Data":"14a55dd24286bc73ad58bf7f5bccaadb5ff68963dcc87209a493b44589341182"}
Sep 11 12:32:01.200902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:01.200868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerStarted","Data":"029646220c769c7edee2336b887801c1b2e7763d9336388647357da7b2bc4fdc"}
Sep 11 12:32:02.206484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:02.206446    2584 generic.go:356] "Generic (PLEG): container finished" podID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerID="029646220c769c7edee2336b887801c1b2e7763d9336388647357da7b2bc4fdc" exitCode=0
Sep 11 12:32:02.206956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:02.206497    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerDied","Data":"029646220c769c7edee2336b887801c1b2e7763d9336388647357da7b2bc4fdc"}
Sep 11 12:32:09.238688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:09.238659    2584 generic.go:356] "Generic (PLEG): container finished" podID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerID="c25ebe3d0346d7ad47f569c6f2bec1071f462ac72534d6121f2cc39204cb956f" exitCode=0
Sep 11 12:32:09.239039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:09.238750    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerDied","Data":"c25ebe3d0346d7ad47f569c6f2bec1071f462ac72534d6121f2cc39204cb956f"}
Sep 11 12:32:10.374169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.374147    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:32:10.412059 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.412019    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle\") pod \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") "
Sep 11 12:32:10.412198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.412077    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util\") pod \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") "
Sep 11 12:32:10.412198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.412111    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdtp9\" (UniqueName: \"kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9\") pod \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\" (UID: \"bff58e88-9c5d-40cb-89c3-ef50464a40ea\") "
Sep 11 12:32:10.412668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.412634    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle" (OuterVolumeSpecName: "bundle") pod "bff58e88-9c5d-40cb-89c3-ef50464a40ea" (UID: "bff58e88-9c5d-40cb-89c3-ef50464a40ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:10.414285 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.414252    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9" (OuterVolumeSpecName: "kube-api-access-cdtp9") pod "bff58e88-9c5d-40cb-89c3-ef50464a40ea" (UID: "bff58e88-9c5d-40cb-89c3-ef50464a40ea"). InnerVolumeSpecName "kube-api-access-cdtp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:32:10.416055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.416015    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util" (OuterVolumeSpecName: "util") pod "bff58e88-9c5d-40cb-89c3-ef50464a40ea" (UID: "bff58e88-9c5d-40cb-89c3-ef50464a40ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:10.513295 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.513213    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdtp9\" (UniqueName: \"kubernetes.io/projected/bff58e88-9c5d-40cb-89c3-ef50464a40ea-kube-api-access-cdtp9\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:10.513295 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.513245    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:10.513295 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:10.513254    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bff58e88-9c5d-40cb-89c3-ef50464a40ea-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:11.248327 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:11.248291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw" event={"ID":"bff58e88-9c5d-40cb-89c3-ef50464a40ea","Type":"ContainerDied","Data":"2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f"}
Sep 11 12:32:11.248490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:11.248341    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a0e4a71018206c7850962ef127319393dc8a62fe6545673d3b32fbbe857df9f"
Sep 11 12:32:11.248490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:11.248306    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sw9zw"
Sep 11 12:32:12.565096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:12.565059    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:13.525566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:13.525532    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:14.496584 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496554    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"]
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496815    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="pull"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496826    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="pull"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496837    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="util"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496842    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="util"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496854    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="extract"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496860    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="extract"
Sep 11 12:32:14.496941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.496906    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bff58e88-9c5d-40cb-89c3-ef50464a40ea" containerName="extract"
Sep 11 12:32:14.499632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.499614    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.504222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.504198    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:32:14.504336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.504234    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 12:32:14.504523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.504494    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zww4g\""
Sep 11 12:32:14.543269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.543241    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"]
Sep 11 12:32:14.543474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.543455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zb95\" (UniqueName: \"kubernetes.io/projected/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-kube-api-access-7zb95\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.543517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.543505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.644704 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.644676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zb95\" (UniqueName: \"kubernetes.io/projected/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-kube-api-access-7zb95\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.644821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.644731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.645074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.645057    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.656898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.656877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zb95\" (UniqueName: \"kubernetes.io/projected/e8e2b317-ace0-4f90-8de0-0ec7fa5f5612-kube-api-access-7zb95\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkxfl\" (UID: \"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:14.808463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:14.808392    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"
Sep 11 12:32:15.093498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:15.093467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl"]
Sep 11 12:32:15.094270 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:15.094245    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e2b317_ace0_4f90_8de0_0ec7fa5f5612.slice/crio-696ea04b22fa4cc78df05faf03df203d6ef42dba4ad2010b1f362c2d26e3fad7 WatchSource:0}: Error finding container 696ea04b22fa4cc78df05faf03df203d6ef42dba4ad2010b1f362c2d26e3fad7: Status 404 returned error can't find the container with id 696ea04b22fa4cc78df05faf03df203d6ef42dba4ad2010b1f362c2d26e3fad7
Sep 11 12:32:15.264412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:15.264383    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl" event={"ID":"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612","Type":"ContainerStarted","Data":"696ea04b22fa4cc78df05faf03df203d6ef42dba4ad2010b1f362c2d26e3fad7"}
Sep 11 12:32:16.367715 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:16.367678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:16.464919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:16.464879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:17.275257 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:17.275226    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl" event={"ID":"e8e2b317-ace0-4f90-8de0-0ec7fa5f5612","Type":"ContainerStarted","Data":"c6ef84e72796981be2e60f5317dcf30445ad788e702edd830fc66155e8fd5e6a"}
Sep 11 12:32:17.310135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:17.310088    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkxfl" podStartSLOduration=1.297842616 podStartE2EDuration="3.310074639s" totalImagesPullingTime="2.012232023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:32:17.30914441 +0000 UTC m=+329.953037080" watchObservedRunningTime="2026-09-11 12:32:17.310074639 +0000 UTC m=+329.953967299"
Sep 11 12:32:18.145805 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.145764    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:18.260958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.260924    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:18.453121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.453044    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"]
Sep 11 12:32:18.455133 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.455117    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.461113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.461087    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:32:18.461242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.461180    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ks7w8\""
Sep 11 12:32:18.462077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.462054    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:32:18.470260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.470240    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"]
Sep 11 12:32:18.573478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.573452    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.573585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.573498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgdfw\" (UniqueName: \"kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.573585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.573518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.674728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.674703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgdfw\" (UniqueName: \"kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.674826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.674736    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.674826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.674771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.675081 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.675063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.675126 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.675104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.684998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.684976    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgdfw\" (UniqueName: \"kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:18.770176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:18.770152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:19.049625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:19.049557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"]
Sep 11 12:32:19.052365 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:19.052332    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27df7833_232c_4c28_ae9f_7d8c0f0eab14.slice/crio-bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a WatchSource:0}: Error finding container bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a: Status 404 returned error can't find the container with id bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a
Sep 11 12:32:19.284418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:19.284386    2584 generic.go:356] "Generic (PLEG): container finished" podID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerID="d71bcd108f1b0664e7f48416e753339087f581f277d2762a37797ec57d9fd40a" exitCode=0
Sep 11 12:32:19.284761 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:19.284471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b" event={"ID":"27df7833-232c-4c28-ae9f-7d8c0f0eab14","Type":"ContainerDied","Data":"d71bcd108f1b0664e7f48416e753339087f581f277d2762a37797ec57d9fd40a"}
Sep 11 12:32:19.284761 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:19.284524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b" event={"ID":"27df7833-232c-4c28-ae9f-7d8c0f0eab14","Type":"ContainerStarted","Data":"bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a"}
Sep 11 12:32:20.439261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:20.439221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:20.637654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:20.637620    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:22.299139 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:22.299101    2584 generic.go:356] "Generic (PLEG): container finished" podID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerID="8296f451fdba60a9f7310273e478d54af8614ab8ba7102c0df9f8703629858a1" exitCode=0
Sep 11 12:32:22.299508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:22.299198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b" event={"ID":"27df7833-232c-4c28-ae9f-7d8c0f0eab14","Type":"ContainerDied","Data":"8296f451fdba60a9f7310273e478d54af8614ab8ba7102c0df9f8703629858a1"}
Sep 11 12:32:22.339873 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:22.339850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:22.428616 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:22.428593    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:23.160103 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:23.160072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:23.259190 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:23.259163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:23.304889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:23.304864    2584 generic.go:356] "Generic (PLEG): container finished" podID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerID="3d7a21dfb5d3e3e2a7562aa8c8a0b85243f74be4f497ab11d9b8d7e95a7d274e" exitCode=0
Sep 11 12:32:23.305228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:23.304923    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b" event={"ID":"27df7833-232c-4c28-ae9f-7d8c0f0eab14","Type":"ContainerDied","Data":"3d7a21dfb5d3e3e2a7562aa8c8a0b85243f74be4f497ab11d9b8d7e95a7d274e"}
Sep 11 12:32:24.427532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.427507    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:24.521992 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.521965    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle\") pod \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") "
Sep 11 12:32:24.522171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.522020    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgdfw\" (UniqueName: \"kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw\") pod \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") "
Sep 11 12:32:24.522171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.522065    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util\") pod \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\" (UID: \"27df7833-232c-4c28-ae9f-7d8c0f0eab14\") "
Sep 11 12:32:24.522379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.522352    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle" (OuterVolumeSpecName: "bundle") pod "27df7833-232c-4c28-ae9f-7d8c0f0eab14" (UID: "27df7833-232c-4c28-ae9f-7d8c0f0eab14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:24.524061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.524021    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw" (OuterVolumeSpecName: "kube-api-access-hgdfw") pod "27df7833-232c-4c28-ae9f-7d8c0f0eab14" (UID: "27df7833-232c-4c28-ae9f-7d8c0f0eab14"). InnerVolumeSpecName "kube-api-access-hgdfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:32:24.526600 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.526580    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util" (OuterVolumeSpecName: "util") pod "27df7833-232c-4c28-ae9f-7d8c0f0eab14" (UID: "27df7833-232c-4c28-ae9f-7d8c0f0eab14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:24.622507 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.622447    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:24.622507 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.622470    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgdfw\" (UniqueName: \"kubernetes.io/projected/27df7833-232c-4c28-ae9f-7d8c0f0eab14-kube-api-access-hgdfw\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:24.622507 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:24.622480    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27df7833-232c-4c28-ae9f-7d8c0f0eab14-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:25.315346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:25.315315    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b"
Sep 11 12:32:25.315346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:25.315335    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4q55b" event={"ID":"27df7833-232c-4c28-ae9f-7d8c0f0eab14","Type":"ContainerDied","Data":"bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a"}
Sep 11 12:32:25.315503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:25.315384    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc460d348ec0a788dadfdb5cc6799156eb606b503f23b08dd89e3c03f3b4128a"
Sep 11 12:32:28.059299 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:28.059264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:29.796227 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796195    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qgrfg"]
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796473    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="extract"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796490    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="extract"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796501    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="pull"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796509    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="pull"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796524    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="util"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796530    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="util"
Sep 11 12:32:29.796798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.796589    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="27df7833-232c-4c28-ae9f-7d8c0f0eab14" containerName="extract"
Sep 11 12:32:29.799640 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.799624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:29.802358 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.802335    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 12:32:29.802650 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.802632    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 12:32:29.803706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.803685    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2rth5\""
Sep 11 12:32:29.809043 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.809007    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qgrfg"]
Sep 11 12:32:29.954547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.954514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-bound-sa-token\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:29.954713 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:29.954553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kmk\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-kube-api-access-h2kmk\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.055467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.055393    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-bound-sa-token\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.055467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.055428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kmk\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-kube-api-access-h2kmk\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.064714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.064684    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-bound-sa-token\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.064834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.064797    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kmk\" (UniqueName: \"kubernetes.io/projected/4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72-kube-api-access-h2kmk\") pod \"cert-manager-55b4d954d5-qgrfg\" (UID: \"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72\") " pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.108697 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.108673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qgrfg"
Sep 11 12:32:30.380196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.380125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qgrfg"]
Sep 11 12:32:30.383241 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:30.383218    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a1a9fc1_71d8_4b13_9c9e_25ab5dcbca72.slice/crio-8ab30e4c7901d6539e2b6c8756f34ddc668d36d1b004ca83ff428f412429792b WatchSource:0}: Error finding container 8ab30e4c7901d6539e2b6c8756f34ddc668d36d1b004ca83ff428f412429792b: Status 404 returned error can't find the container with id 8ab30e4c7901d6539e2b6c8756f34ddc668d36d1b004ca83ff428f412429792b
Sep 11 12:32:30.670345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.670268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:30.758706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:30.758666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:31.342093 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:31.342053    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qgrfg" event={"ID":"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72","Type":"ContainerStarted","Data":"8ab30e4c7901d6539e2b6c8756f34ddc668d36d1b004ca83ff428f412429792b"}
Sep 11 12:32:33.351880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:33.351789    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qgrfg" event={"ID":"4a1a9fc1-71d8-4b13-9c9e-25ab5dcbca72","Type":"ContainerStarted","Data":"a1d1ff9a8b91732255f9f84665c650ceae8e4ee3043d2b99b87413cea551c9c4"}
Sep 11 12:32:33.373349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:33.373300    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qgrfg" podStartSLOduration=1.72535209 podStartE2EDuration="4.373285302s" totalImagesPullingTime="2.647933212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:32:33.3713243 +0000 UTC m=+346.015216957" watchObservedRunningTime="2026-09-11 12:32:33.373285302 +0000 UTC m=+346.017177959"
Sep 11 12:32:37.663642 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:37.663595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:37.765210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:37.765180    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:39.076778 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.076744    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"]
Sep 11 12:32:39.080060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.080023    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.083021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.083003    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ks7w8\""
Sep 11 12:32:39.083144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.083081    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:32:39.084181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.084164    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:32:39.093047 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.093009    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"]
Sep 11 12:32:39.220238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.220215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.220353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.220243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwltm\" (UniqueName: \"kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.220353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.220261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.320857 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.320835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.320978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.320863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwltm\" (UniqueName: \"kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.320978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.320882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.321331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.321311    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.321371 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.321314    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.330205 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.330150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwltm\" (UniqueName: \"kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.373956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.373927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:39.388798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.388762    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:39.658664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:39.658467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"]
Sep 11 12:32:39.661269 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:39.661239    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf032ed49_8904_4072_9f13_450625187ef4.slice/crio-97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23 WatchSource:0}: Error finding container 97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23: Status 404 returned error can't find the container with id 97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23
Sep 11 12:32:40.381733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:40.381697    2584 generic.go:356] "Generic (PLEG): container finished" podID="f032ed49-8904-4072-9f13-450625187ef4" containerID="c514e1cf80db98f9a1b0d2fce7fd9be8fbda0f3be1a740da6ccba6eb593ccfd7" exitCode=0
Sep 11 12:32:40.382096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:40.381780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl" event={"ID":"f032ed49-8904-4072-9f13-450625187ef4","Type":"ContainerDied","Data":"c514e1cf80db98f9a1b0d2fce7fd9be8fbda0f3be1a740da6ccba6eb593ccfd7"}
Sep 11 12:32:40.382096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:40.381832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl" event={"ID":"f032ed49-8904-4072-9f13-450625187ef4","Type":"ContainerStarted","Data":"97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23"}
Sep 11 12:32:42.391232 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:42.391199    2584 generic.go:356] "Generic (PLEG): container finished" podID="f032ed49-8904-4072-9f13-450625187ef4" containerID="d5ae5061ecb4eb0b559c30f6a32ad32141c9278d90c1c1c5bce077d2fe90215b" exitCode=0
Sep 11 12:32:42.391669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:42.391242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl" event={"ID":"f032ed49-8904-4072-9f13-450625187ef4","Type":"ContainerDied","Data":"d5ae5061ecb4eb0b559c30f6a32ad32141c9278d90c1c1c5bce077d2fe90215b"}
Sep 11 12:32:43.397357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:43.397327    2584 generic.go:356] "Generic (PLEG): container finished" podID="f032ed49-8904-4072-9f13-450625187ef4" containerID="fb031874d4748f404009b86386382b3465ea069ae99308f6af3966c5914bae07" exitCode=0
Sep 11 12:32:43.397725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:43.397419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl" event={"ID":"f032ed49-8904-4072-9f13-450625187ef4","Type":"ContainerDied","Data":"fb031874d4748f404009b86386382b3465ea069ae99308f6af3966c5914bae07"}
Sep 11 12:32:44.524990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.524945    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:44.529838 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.529817    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:44.593036 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.592995    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:44.658022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.657959    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util\") pod \"f032ed49-8904-4072-9f13-450625187ef4\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") "
Sep 11 12:32:44.658022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.658008    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwltm\" (UniqueName: \"kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm\") pod \"f032ed49-8904-4072-9f13-450625187ef4\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") "
Sep 11 12:32:44.658194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.658077    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle\") pod \"f032ed49-8904-4072-9f13-450625187ef4\" (UID: \"f032ed49-8904-4072-9f13-450625187ef4\") "
Sep 11 12:32:44.658767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.658743    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle" (OuterVolumeSpecName: "bundle") pod "f032ed49-8904-4072-9f13-450625187ef4" (UID: "f032ed49-8904-4072-9f13-450625187ef4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:44.660064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.660023    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm" (OuterVolumeSpecName: "kube-api-access-cwltm") pod "f032ed49-8904-4072-9f13-450625187ef4" (UID: "f032ed49-8904-4072-9f13-450625187ef4"). InnerVolumeSpecName "kube-api-access-cwltm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:32:44.663446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.663427    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util" (OuterVolumeSpecName: "util") pod "f032ed49-8904-4072-9f13-450625187ef4" (UID: "f032ed49-8904-4072-9f13-450625187ef4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:44.759574 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.759549    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:44.759574 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.759572    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwltm\" (UniqueName: \"kubernetes.io/projected/f032ed49-8904-4072-9f13-450625187ef4-kube-api-access-cwltm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:44.759698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:44.759581    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f032ed49-8904-4072-9f13-450625187ef4-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:45.407491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:45.407466    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl"
Sep 11 12:32:45.407664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:45.407463    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz2bnl" event={"ID":"f032ed49-8904-4072-9f13-450625187ef4","Type":"ContainerDied","Data":"97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23"}
Sep 11 12:32:45.407664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:45.407581    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97242741423c3d013d05cd153444d175773f6ef3adc5fcb3d76a48a9ab338b23"
Sep 11 12:32:53.464675 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.464637    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"]
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465006    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="extract"
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465041    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="extract"
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465064    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="util"
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465072    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="util"
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465091    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="pull"
Sep 11 12:32:53.465151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465099    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="pull"
Sep 11 12:32:53.465464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.465170    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f032ed49-8904-4072-9f13-450625187ef4" containerName="extract"
Sep 11 12:32:53.476042 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.476003    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.480801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.480775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ks7w8\""
Sep 11 12:32:53.481024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.480999    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:32:53.481872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.481851    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:32:53.497183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.497161    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"]
Sep 11 12:32:53.624001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.623980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmn6w\" (UniqueName: \"kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.624120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.624046    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.624120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.624080    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.724357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.724304    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.724357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.724339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.724478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.724378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmn6w\" (UniqueName: \"kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.724669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.724650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.724733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.724716    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.741187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.741160    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmn6w\" (UniqueName: \"kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:53.784875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:53.784854    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:54.061249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.061131    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"]
Sep 11 12:32:54.063718 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:54.063691    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9205e24_47a6_460d_b868_7170544caf2a.slice/crio-1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3 WatchSource:0}: Error finding container 1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3: Status 404 returned error can't find the container with id 1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3
Sep 11 12:32:54.445766 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.445685    2584 generic.go:356] "Generic (PLEG): container finished" podID="f9205e24-47a6-460d-b868-7170544caf2a" containerID="69dc1aec498b5a2fb774d5d502f3396b222a26c70d4d34acb35209d2bfd218d7" exitCode=0
Sep 11 12:32:54.445901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.445769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9" event={"ID":"f9205e24-47a6-460d-b868-7170544caf2a","Type":"ContainerDied","Data":"69dc1aec498b5a2fb774d5d502f3396b222a26c70d4d34acb35209d2bfd218d7"}
Sep 11 12:32:54.445901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.445822    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9" event={"ID":"f9205e24-47a6-460d-b868-7170544caf2a","Type":"ContainerStarted","Data":"1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3"}
Sep 11 12:32:54.569627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.569590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:54.674638 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:54.674597    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:55.248813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.248779    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:55.451717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.451639    2584 generic.go:356] "Generic (PLEG): container finished" podID="f9205e24-47a6-460d-b868-7170544caf2a" containerID="b7056ac353d8d5a6f657b0eeac0ec6ae2d106c94e6c3275a5fc9b271b68aa265" exitCode=0
Sep 11 12:32:55.451717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.451714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9" event={"ID":"f9205e24-47a6-460d-b868-7170544caf2a","Type":"ContainerDied","Data":"b7056ac353d8d5a6f657b0eeac0ec6ae2d106c94e6c3275a5fc9b271b68aa265"}
Sep 11 12:32:55.602801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.602767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:55.717720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.717663    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"]
Sep 11 12:32:55.720901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.720876    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.721077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.721024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:55.727924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.727903    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d9rvx\""
Sep 11 12:32:55.728324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.728306    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 12:32:55.728553 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.728537    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 12:32:55.728602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.728568    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 12:32:55.728833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.728814    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 12:32:55.747370 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.747350    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"]
Sep 11 12:32:55.838802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.838771    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.838904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.838810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.838904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.838834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.838990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.838926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j86jm\" (UniqueName: \"kubernetes.io/projected/521dc1f8-c5ca-4435-8f70-474852792e51-kube-api-access-j86jm\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.838990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.838980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.917191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.917165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:55.939589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j86jm\" (UniqueName: \"kubernetes.io/projected/521dc1f8-c5ca-4435-8f70-474852792e51-kube-api-access-j86jm\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.939688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.939688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939631    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.939688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.939688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.940017 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.939991    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.941832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.941812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/521dc1f8-c5ca-4435-8f70-474852792e51-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.942160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.942135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.942235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.942160    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/521dc1f8-c5ca-4435-8f70-474852792e51-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:55.954376 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:55.954349    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j86jm\" (UniqueName: \"kubernetes.io/projected/521dc1f8-c5ca-4435-8f70-474852792e51-kube-api-access-j86jm\") pod \"opendatahub-operator-controller-manager-65cbc8d955-dgwkc\" (UID: \"521dc1f8-c5ca-4435-8f70-474852792e51\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:56.030797 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.030762    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:32:56.044709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.044634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:56.178758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.178726    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:56.272168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.272141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:32:56.318387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.318313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"]
Sep 11 12:32:56.322267 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:32:56.322238    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521dc1f8_c5ca_4435_8f70_474852792e51.slice/crio-3db955e56eb7b1073f149f01cdf0f0ab27c67c4af829b69acaa42b9bec971643 WatchSource:0}: Error finding container 3db955e56eb7b1073f149f01cdf0f0ab27c67c4af829b69acaa42b9bec971643: Status 404 returned error can't find the container with id 3db955e56eb7b1073f149f01cdf0f0ab27c67c4af829b69acaa42b9bec971643
Sep 11 12:32:56.457091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.457057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc" event={"ID":"521dc1f8-c5ca-4435-8f70-474852792e51","Type":"ContainerStarted","Data":"3db955e56eb7b1073f149f01cdf0f0ab27c67c4af829b69acaa42b9bec971643"}
Sep 11 12:32:56.458991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.458957    2584 generic.go:356] "Generic (PLEG): container finished" podID="f9205e24-47a6-460d-b868-7170544caf2a" containerID="733c72d2a4e0cbaaaa7ece744c1c65d4bde169045e11873be27105129c003c6e" exitCode=0
Sep 11 12:32:56.459093 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:56.459024    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9" event={"ID":"f9205e24-47a6-460d-b868-7170544caf2a","Type":"ContainerDied","Data":"733c72d2a4e0cbaaaa7ece744c1c65d4bde169045e11873be27105129c003c6e"}
Sep 11 12:32:57.599409 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.599381    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:32:57.753859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.753833    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util\") pod \"f9205e24-47a6-460d-b868-7170544caf2a\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") "
Sep 11 12:32:57.754053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.753871    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle\") pod \"f9205e24-47a6-460d-b868-7170544caf2a\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") "
Sep 11 12:32:57.754053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.753914    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmn6w\" (UniqueName: \"kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w\") pod \"f9205e24-47a6-460d-b868-7170544caf2a\" (UID: \"f9205e24-47a6-460d-b868-7170544caf2a\") "
Sep 11 12:32:57.754815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.754727    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle" (OuterVolumeSpecName: "bundle") pod "f9205e24-47a6-460d-b868-7170544caf2a" (UID: "f9205e24-47a6-460d-b868-7170544caf2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:57.757516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.757195    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w" (OuterVolumeSpecName: "kube-api-access-jmn6w") pod "f9205e24-47a6-460d-b868-7170544caf2a" (UID: "f9205e24-47a6-460d-b868-7170544caf2a"). InnerVolumeSpecName "kube-api-access-jmn6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:32:57.762331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.762268    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util" (OuterVolumeSpecName: "util") pod "f9205e24-47a6-460d-b868-7170544caf2a" (UID: "f9205e24-47a6-460d-b868-7170544caf2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:32:57.854820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.854796    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:57.854820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.854821    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9205e24-47a6-460d-b868-7170544caf2a-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:57.855018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:57.854836    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmn6w\" (UniqueName: \"kubernetes.io/projected/f9205e24-47a6-460d-b868-7170544caf2a-kube-api-access-jmn6w\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:32:58.471548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:58.471508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9" event={"ID":"f9205e24-47a6-460d-b868-7170544caf2a","Type":"ContainerDied","Data":"1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3"}
Sep 11 12:32:58.471752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:58.471577    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1272e701de66ead0f73f17517471e1510eecbcdd5b6990787a72fa9d52b359e3"
Sep 11 12:32:58.471752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:32:58.471521    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hz7m9"
Sep 11 12:33:00.482331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:00.482292    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc" event={"ID":"521dc1f8-c5ca-4435-8f70-474852792e51","Type":"ContainerStarted","Data":"1cc5f0e21244e730339122d572ac3236fe324401e6ec5fedf4aecdd394f0682d"}
Sep 11 12:33:01.488595 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:01.488564    2584 generic.go:356] "Generic (PLEG): container finished" podID="521dc1f8-c5ca-4435-8f70-474852792e51" containerID="1cc5f0e21244e730339122d572ac3236fe324401e6ec5fedf4aecdd394f0682d" exitCode=0
Sep 11 12:33:01.489090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:01.488649    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc" event={"ID":"521dc1f8-c5ca-4435-8f70-474852792e51","Type":"ContainerDied","Data":"1cc5f0e21244e730339122d572ac3236fe324401e6ec5fedf4aecdd394f0682d"}
Sep 11 12:33:02.495595 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:02.495560    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc" event={"ID":"521dc1f8-c5ca-4435-8f70-474852792e51","Type":"ContainerStarted","Data":"34fe0eb4043903032ea74b9b4017dff02966beac9b0e1dd8d4431295f5e36cc1"}
Sep 11 12:33:02.495987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:02.495749    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:33:02.523804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:02.523754    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc" podStartSLOduration=2.740705724 podStartE2EDuration="7.523733125s" totalImagesPullingTime="3.708521721s" totalInitContainerRuntime="1.07450568s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:32:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:02.52220674 +0000 UTC m=+375.166099411" watchObservedRunningTime="2026-09-11 12:33:02.523733125 +0000 UTC m=+375.167625786"
Sep 11 12:33:03.687514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:03.687482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:03.788079 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:03.788050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:13.501998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:13.501965    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-dgwkc"
Sep 11 12:33:16.244543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.244511    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:16.409886 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.409843    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:16.801666 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.801633    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:16.880189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880156    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"]
Sep 11 12:33:16.880431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880412    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="extract"
Sep 11 12:33:16.880431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880426    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="extract"
Sep 11 12:33:16.880569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880439    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="util"
Sep 11 12:33:16.880569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880446    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="util"
Sep 11 12:33:16.880569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880452    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="pull"
Sep 11 12:33:16.880569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880457    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="pull"
Sep 11 12:33:16.880569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.880513    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9205e24-47a6-460d-b868-7170544caf2a" containerName="extract"
Sep 11 12:33:16.883641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.883624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.887979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.887958    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 12:33:16.888790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.888769    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-h7zg9\""
Sep 11 12:33:16.888881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.888814    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 12:33:16.888881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.888856    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 12:33:16.889465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.889446    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 12:33:16.891850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.891825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5770f6df-8ee9-43bf-8bf6-2869167405e7-tls-certs\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.891948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.891872    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntsq\" (UniqueName: \"kubernetes.io/projected/5770f6df-8ee9-43bf-8bf6-2869167405e7-kube-api-access-mntsq\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.891948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.891918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5770f6df-8ee9-43bf-8bf6-2869167405e7-tmp\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.905675 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.905651    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"]
Sep 11 12:33:16.992777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.992748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5770f6df-8ee9-43bf-8bf6-2869167405e7-tls-certs\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.992901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.992788    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntsq\" (UniqueName: \"kubernetes.io/projected/5770f6df-8ee9-43bf-8bf6-2869167405e7-kube-api-access-mntsq\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.992901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.992810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5770f6df-8ee9-43bf-8bf6-2869167405e7-tmp\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.994983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.994961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5770f6df-8ee9-43bf-8bf6-2869167405e7-tmp\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:16.995232 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:16.995212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5770f6df-8ee9-43bf-8bf6-2869167405e7-tls-certs\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:17.014973 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:17.014940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntsq\" (UniqueName: \"kubernetes.io/projected/5770f6df-8ee9-43bf-8bf6-2869167405e7-kube-api-access-mntsq\") pod \"kube-auth-proxy-67c8b95cc4-v8c4m\" (UID: \"5770f6df-8ee9-43bf-8bf6-2869167405e7\") " pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:17.192914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:17.192834    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"
Sep 11 12:33:17.493773 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:17.493742    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m"]
Sep 11 12:33:17.494649 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:33:17.494626    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5770f6df_8ee9_43bf_8bf6_2869167405e7.slice/crio-e4f8ad1c89cfe4d7f0440c53005d763f4e35471618c9b3cb1677108f3e65f79a WatchSource:0}: Error finding container e4f8ad1c89cfe4d7f0440c53005d763f4e35471618c9b3cb1677108f3e65f79a: Status 404 returned error can't find the container with id e4f8ad1c89cfe4d7f0440c53005d763f4e35471618c9b3cb1677108f3e65f79a
Sep 11 12:33:17.564956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:17.564926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m" event={"ID":"5770f6df-8ee9-43bf-8bf6-2869167405e7","Type":"ContainerStarted","Data":"e4f8ad1c89cfe4d7f0440c53005d763f4e35471618c9b3cb1677108f3e65f79a"}
Sep 11 12:33:17.605570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:17.605540    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:18.684239 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.684200    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:18.687815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.687788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.690580 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.690556    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 12:33:18.690723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.690590    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 12:33:18.690989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.690973    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7qncw\""
Sep 11 12:33:18.691130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.691110    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 12:33:18.691443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.691428    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 12:33:18.698264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.698236    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:18.704196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.704176    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:18.706383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706554 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzmk5\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.706697 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.706688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.804012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.803979    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:18.807586 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807557    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzmk5\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.807893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.807864    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.808777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.808756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.810778 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.810753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.811000 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.810966    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.811279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.811258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.811519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.811501    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.822136 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.822096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.823489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.823458    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzmk5\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5\") pod \"istiod-openshift-gateway-7b7995d5cd-2f7px\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:18.997874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:18.997839    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:20.149042 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:20.148987    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:20.556258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:20.556234    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:20.557363 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:33:20.557336    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb747cd_6306_464e_9d9f_1a149468d285.slice/crio-c48eeb004c09027ccf25a2c038060020b4839378e4a9095f5cc426a66143f3da WatchSource:0}: Error finding container c48eeb004c09027ccf25a2c038060020b4839378e4a9095f5cc426a66143f3da: Status 404 returned error can't find the container with id c48eeb004c09027ccf25a2c038060020b4839378e4a9095f5cc426a66143f3da
Sep 11 12:33:20.581723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:20.581693    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" event={"ID":"bcb747cd-6306-464e-9d9f-1a149468d285","Type":"ContainerStarted","Data":"c48eeb004c09027ccf25a2c038060020b4839378e4a9095f5cc426a66143f3da"}
Sep 11 12:33:20.583137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:20.583116    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m" event={"ID":"5770f6df-8ee9-43bf-8bf6-2869167405e7","Type":"ContainerStarted","Data":"253c9b67165a9796d166dffd6229ed581fde0a4c4dce77a702d90feefa35f9ba"}
Sep 11 12:33:20.601959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:20.601804    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67c8b95cc4-v8c4m" podStartSLOduration=1.751976452 podStartE2EDuration="4.601791596s" totalImagesPullingTime="2.849815144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:20.601700712 +0000 UTC m=+393.245593370" watchObservedRunningTime="2026-09-11 12:33:20.601791596 +0000 UTC m=+393.245684254"
Sep 11 12:33:22.975013 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:22.974982    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:33:22.975277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:22.975060    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:33:23.600510 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:23.600478    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" event={"ID":"bcb747cd-6306-464e-9d9f-1a149468d285","Type":"ContainerStarted","Data":"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"}
Sep 11 12:33:23.600671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:23.600535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:23.843578 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:23.843541    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:23.942669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:23.942586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:24.527039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:24.526989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:24.606601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:24.606575    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:24.632544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:24.632496    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" podStartSLOduration=4.217215919 podStartE2EDuration="6.632480798s" totalImagesPullingTime="2.415264879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:23.622594315 +0000 UTC m=+396.266486977" watchObservedRunningTime="2026-09-11 12:33:24.632480798 +0000 UTC m=+397.276373455"
Sep 11 12:33:24.715953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:24.715917    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:24.817825 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:24.817723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:27.427476 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:27.427436    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:27.527547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:27.527508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:27.628652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:27.628610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:27.772269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:27.772241    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:27.963244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:27.963208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:28.100164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:28.100089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:38.335645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.335610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:38.431191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.431166    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"]
Sep 11 12:33:38.438602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.438580    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.441540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.441514    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 12:33:38.441540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.441530    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-msqhm\""
Sep 11 12:33:38.448075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.445973    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"]
Sep 11 12:33:38.452288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.452270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.456010 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.455987    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"]
Sep 11 12:33:38.457896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.457876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-98wws\""
Sep 11 12:33:38.458081 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.458060    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 12:33:38.458383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.458354    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:38.463071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.463051    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"]
Sep 11 12:33:38.566664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.566627    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7wf\" (UniqueName: \"kubernetes.io/projected/31f5b960-5c15-40cb-be86-244a5d78df78-kube-api-access-2x7wf\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.566664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.566664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.566875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.566698    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b960-5c15-40cb-be86-244a5d78df78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.566875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.566744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzv99\" (UniqueName: \"kubernetes.io/projected/89c9caae-8007-400d-908d-bb3d67f2f681-kube-api-access-pzv99\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.668002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.667931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b960-5c15-40cb-be86-244a5d78df78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.668002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.667962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzv99\" (UniqueName: \"kubernetes.io/projected/89c9caae-8007-400d-908d-bb3d67f2f681-kube-api-access-pzv99\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.668203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.668006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7wf\" (UniqueName: \"kubernetes.io/projected/31f5b960-5c15-40cb-be86-244a5d78df78-kube-api-access-2x7wf\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.668203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.668050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.668203 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:33:38.668136    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 12:33:38.668203 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:33:38.668196    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert podName:89c9caae-8007-400d-908d-bb3d67f2f681 nodeName:}" failed. No retries permitted until 2026-09-11 12:33:39.168182188 +0000 UTC m=+411.812074824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert") pod "kserve-controller-manager-d6f4b65b8-tc8tl" (UID: "89c9caae-8007-400d-908d-bb3d67f2f681") : secret "kserve-webhook-server-cert" not found
Sep 11 12:33:38.670427 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.670402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b960-5c15-40cb-be86-244a5d78df78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.684696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.684667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7wf\" (UniqueName: \"kubernetes.io/projected/31f5b960-5c15-40cb-be86-244a5d78df78-kube-api-access-2x7wf\") pod \"llmisvc-controller-manager-777c6bd7d5-mqfzv\" (UID: \"31f5b960-5c15-40cb-be86-244a5d78df78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.685019 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.684997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzv99\" (UniqueName: \"kubernetes.io/projected/89c9caae-8007-400d-908d-bb3d67f2f681-kube-api-access-pzv99\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:38.728290 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.728244    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:38.764627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.764604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:38.889357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.889325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:38.993422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:38.993386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:39.039314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.039287    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"]
Sep 11 12:33:39.042013 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:33:39.041978    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod31f5b960_5c15_40cb_be86_244a5d78df78.slice/crio-4b698758ac593c664fedb6cec0f0cec9f04fb240e0f33ad83208c130f99a3b69 WatchSource:0}: Error finding container 4b698758ac593c664fedb6cec0f0cec9f04fb240e0f33ad83208c130f99a3b69: Status 404 returned error can't find the container with id 4b698758ac593c664fedb6cec0f0cec9f04fb240e0f33ad83208c130f99a3b69
Sep 11 12:33:39.171836 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.171811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:39.174178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.174155    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c9caae-8007-400d-908d-bb3d67f2f681-cert\") pod \"kserve-controller-manager-d6f4b65b8-tc8tl\" (UID: \"89c9caae-8007-400d-908d-bb3d67f2f681\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:39.350701 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.350647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:39.622725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.622632    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"]
Sep 11 12:33:39.625267 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:33:39.625238    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c9caae_8007_400d_908d_bb3d67f2f681.slice/crio-56bb71aefadcb13523752553ea98a56f0d0b7a5d65a5ab4b33c9d144cb46b6c1 WatchSource:0}: Error finding container 56bb71aefadcb13523752553ea98a56f0d0b7a5d65a5ab4b33c9d144cb46b6c1: Status 404 returned error can't find the container with id 56bb71aefadcb13523752553ea98a56f0d0b7a5d65a5ab4b33c9d144cb46b6c1
Sep 11 12:33:39.672519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.672495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl" event={"ID":"89c9caae-8007-400d-908d-bb3d67f2f681","Type":"ContainerStarted","Data":"56bb71aefadcb13523752553ea98a56f0d0b7a5d65a5ab4b33c9d144cb46b6c1"}
Sep 11 12:33:39.673779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:39.673757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv" event={"ID":"31f5b960-5c15-40cb-be86-244a5d78df78","Type":"ContainerStarted","Data":"4b698758ac593c664fedb6cec0f0cec9f04fb240e0f33ad83208c130f99a3b69"}
Sep 11 12:33:40.811484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:40.811422    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:40.811937 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:40.811658    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" podUID="bcb747cd-6306-464e-9d9f-1a149468d285" containerName="discovery" containerID="cri-o://350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e" gracePeriod=30
Sep 11 12:33:41.083608 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.083575    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:41.191039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.190993    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191216 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191067    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191216 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191177    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191226    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191258    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191292    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzmk5\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191481 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191331    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap\") pod \"bcb747cd-6306-464e-9d9f-1a149468d285\" (UID: \"bcb747cd-6306-464e-9d9f-1a149468d285\") "
Sep 11 12:33:41.191971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.191930    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:33:41.193808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.193725    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:33:41.193808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.193751    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:33:41.194054 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.193889    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts" (OuterVolumeSpecName: "cacerts") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:33:41.194181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.194151    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:33:41.194296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.194203    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs" (OuterVolumeSpecName: "local-certs") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:33:41.194355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.194297    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5" (OuterVolumeSpecName: "kube-api-access-zzmk5") pod "bcb747cd-6306-464e-9d9f-1a149468d285" (UID: "bcb747cd-6306-464e-9d9f-1a149468d285"). InnerVolumeSpecName "kube-api-access-zzmk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:33:41.292164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292128    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292163    2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-kubeconfig\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292178    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-dns-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292193    2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcb747cd-6306-464e-9d9f-1a149468d285-local-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292206    2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bcb747cd-6306-464e-9d9f-1a149468d285-cacerts\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292219    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzmk5\" (UniqueName: \"kubernetes.io/projected/bcb747cd-6306-464e-9d9f-1a149468d285-kube-api-access-zzmk5\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.292389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.292234    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bcb747cd-6306-464e-9d9f-1a149468d285-istio-csr-ca-configmap\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:33:41.688309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.688270    2584 generic.go:356] "Generic (PLEG): container finished" podID="bcb747cd-6306-464e-9d9f-1a149468d285" containerID="350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e" exitCode=0
Sep 11 12:33:41.688514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.688326    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"
Sep 11 12:33:41.688514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.688330    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" event={"ID":"bcb747cd-6306-464e-9d9f-1a149468d285","Type":"ContainerDied","Data":"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"}
Sep 11 12:33:41.688514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.688469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px" event={"ID":"bcb747cd-6306-464e-9d9f-1a149468d285","Type":"ContainerDied","Data":"c48eeb004c09027ccf25a2c038060020b4839378e4a9095f5cc426a66143f3da"}
Sep 11 12:33:41.688514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.688508    2584 scope.go:117] "RemoveContainer" containerID="350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"
Sep 11 12:33:41.720342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.720314    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:41.726325 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.726295    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2f7px"]
Sep 11 12:33:41.788677 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.788655    2584 scope.go:117] "RemoveContainer" containerID="350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"
Sep 11 12:33:41.789020 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:33:41.789001    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e\": container with ID starting with 350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e not found: ID does not exist" containerID="350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"
Sep 11 12:33:41.789089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.789047    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e"} err="failed to get container status \"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e\": rpc error: code = NotFound desc = could not find container \"350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e\": container with ID starting with 350e13078d279acce92324d4e437f781e52d856e11adc3886fff589f2170b58e not found: ID does not exist"
Sep 11 12:33:41.878748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:41.878712    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb747cd-6306-464e-9d9f-1a149468d285" path="/var/lib/kubelet/pods/bcb747cd-6306-464e-9d9f-1a149468d285/volumes"
Sep 11 12:33:42.694771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.694664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl" event={"ID":"89c9caae-8007-400d-908d-bb3d67f2f681","Type":"ContainerStarted","Data":"a7c471c10c0af2a278c2378fb2918231cef8d9c4cabac75a49d6da1f761901fc"}
Sep 11 12:33:42.695012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.694850    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:33:42.697333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.697309    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv" event={"ID":"31f5b960-5c15-40cb-be86-244a5d78df78","Type":"ContainerStarted","Data":"62104914c3995d21656b2065a802a758ef9b0bde5425f48a5ea678b7f8371c40"}
Sep 11 12:33:42.697458 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.697440    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:33:42.723646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.723596    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl" podStartSLOduration=1.977340816 podStartE2EDuration="4.72358266s" totalImagesPullingTime="2.746241844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:42.720758639 +0000 UTC m=+415.364651297" watchObservedRunningTime="2026-09-11 12:33:42.72358266 +0000 UTC m=+415.367475344"
Sep 11 12:33:42.782002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:42.779405    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv" podStartSLOduration=1.451894856 podStartE2EDuration="4.779384622s" totalImagesPullingTime="3.327489766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:42.775633051 +0000 UTC m=+415.419525708" watchObservedRunningTime="2026-09-11 12:33:42.779384622 +0000 UTC m=+415.423277282"
Sep 11 12:33:46.067506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.067469    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc744f876-jgnwm"]
Sep 11 12:33:46.067859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.067780    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb747cd-6306-464e-9d9f-1a149468d285" containerName="discovery"
Sep 11 12:33:46.067859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.067792    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb747cd-6306-464e-9d9f-1a149468d285" containerName="discovery"
Sep 11 12:33:46.067859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.067849    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb747cd-6306-464e-9d9f-1a149468d285" containerName="discovery"
Sep 11 12:33:46.070964 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.070946    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.082525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.082499    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc744f876-jgnwm"]
Sep 11 12:33:46.131521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131497    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-service-ca\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-oauth-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dtzl\" (UniqueName: \"kubernetes.io/projected/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-kube-api-access-5dtzl\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-oauth-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.131866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.131668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-trusted-ca-bundle\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.133802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.133772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:46.232098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232106    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-service-ca\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232176    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-oauth-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dtzl\" (UniqueName: \"kubernetes.io/projected/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-kube-api-access-5dtzl\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-oauth-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-trusted-ca-bundle\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.232961 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-service-ca\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.233104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.232995    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.233104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.233024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-oauth-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.233235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.233149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-trusted-ca-bundle\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.234622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.234603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-serving-cert\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.234703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.234625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-console-oauth-config\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.244004 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.243981    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dtzl\" (UniqueName: \"kubernetes.io/projected/18cecaf8-ca75-4efd-83ab-1f2fcb22ab04-kube-api-access-5dtzl\") pod \"console-7dc744f876-jgnwm\" (UID: \"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04\") " pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.379950 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.379867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:46.654082 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.654059    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc744f876-jgnwm"]
Sep 11 12:33:46.655421 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:33:46.655396    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cecaf8_ca75_4efd_83ab_1f2fcb22ab04.slice/crio-22d96c6400dc8eeb96c1ef56b712239f5a42b00e86312098575ebd0f3c45b6de WatchSource:0}: Error finding container 22d96c6400dc8eeb96c1ef56b712239f5a42b00e86312098575ebd0f3c45b6de: Status 404 returned error can't find the container with id 22d96c6400dc8eeb96c1ef56b712239f5a42b00e86312098575ebd0f3c45b6de
Sep 11 12:33:46.719319 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.719291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc744f876-jgnwm" event={"ID":"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04","Type":"ContainerStarted","Data":"056349c68f771bb9153b5bb617541f270e6cf09629cd9557d0817c6f931b0a2c"}
Sep 11 12:33:46.719411 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.719345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc744f876-jgnwm" event={"ID":"18cecaf8-ca75-4efd-83ab-1f2fcb22ab04","Type":"ContainerStarted","Data":"22d96c6400dc8eeb96c1ef56b712239f5a42b00e86312098575ebd0f3c45b6de"}
Sep 11 12:33:46.745111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:46.744971    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc744f876-jgnwm" podStartSLOduration=0.744955583 podStartE2EDuration="744.955583ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:46.742113942 +0000 UTC m=+419.386006601" watchObservedRunningTime="2026-09-11 12:33:46.744955583 +0000 UTC m=+419.388848241"
Sep 11 12:33:49.381866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:49.381833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:49.493078 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:49.493046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:51.381064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:51.381013    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:51.471186 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:51.471152    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:56.380728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:56.380676    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:56.381289 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:56.380751    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:56.385632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:56.385608    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:56.772432 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:56.772405    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc744f876-jgnwm"
Sep 11 12:33:56.864760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:56.864728    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:33:57.000624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:57.000589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:57.099911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:57.099822    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:33:57.200165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:33:57.200132    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:01.988403 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:01.988365    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:13.704183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:13.704104    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mqfzv"
Sep 11 12:34:13.707139 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:13.707118    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tc8tl"
Sep 11 12:34:21.882979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:21.882943    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-798d5554dd-9wg8c" podUID="092c4718-3e73-4606-9522-acc348e02d4c" containerName="console" containerID="cri-o://e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb" gracePeriod=15
Sep 11 12:34:22.122255 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.122230    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:34:22.310331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310333    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqbh4\" (UniqueName: \"kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310528 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310359    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310528 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310612 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310585    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310671    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310711    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config\") pod \"092c4718-3e73-4606-9522-acc348e02d4c\" (UID: \"092c4718-3e73-4606-9522-acc348e02d4c\") "
Sep 11 12:34:22.310824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:34:22.310908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.310820    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:34:22.311111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.311089    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca" (OuterVolumeSpecName: "service-ca") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:34:22.311191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.311121    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-oauth-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.311191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.311141    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-trusted-ca-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.311191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.311181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config" (OuterVolumeSpecName: "console-config") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:34:22.312592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.312560    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4" (OuterVolumeSpecName: "kube-api-access-hqbh4") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "kube-api-access-hqbh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:34:22.312690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.312590    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:34:22.312690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.312572    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "092c4718-3e73-4606-9522-acc348e02d4c" (UID: "092c4718-3e73-4606-9522-acc348e02d4c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:34:22.412157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.412126    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-serving-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.412157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.412154    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqbh4\" (UniqueName: \"kubernetes.io/projected/092c4718-3e73-4606-9522-acc348e02d4c-kube-api-access-hqbh4\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.412157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.412164    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/092c4718-3e73-4606-9522-acc348e02d4c-console-oauth-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.412343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.412174    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.412343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.412184    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/092c4718-3e73-4606-9522-acc348e02d4c-console-config\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:22.891588 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.891552    2584 generic.go:356] "Generic (PLEG): container finished" podID="092c4718-3e73-4606-9522-acc348e02d4c" containerID="e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb" exitCode=0
Sep 11 12:34:22.891960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.891600    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798d5554dd-9wg8c"
Sep 11 12:34:22.891960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.891597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798d5554dd-9wg8c" event={"ID":"092c4718-3e73-4606-9522-acc348e02d4c","Type":"ContainerDied","Data":"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"}
Sep 11 12:34:22.891960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.891724    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798d5554dd-9wg8c" event={"ID":"092c4718-3e73-4606-9522-acc348e02d4c","Type":"ContainerDied","Data":"5af5021307d21a55567a817b42146bfc6c2f8326382eec6d42962f5fdda1e089"}
Sep 11 12:34:22.891960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.891750    2584 scope.go:117] "RemoveContainer" containerID="e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"
Sep 11 12:34:22.900452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.900435    2584 scope.go:117] "RemoveContainer" containerID="e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"
Sep 11 12:34:22.900719 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:34:22.900701    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb\": container with ID starting with e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb not found: ID does not exist" containerID="e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"
Sep 11 12:34:22.900773 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.900727    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb"} err="failed to get container status \"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb\": rpc error: code = NotFound desc = could not find container \"e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb\": container with ID starting with e4bb29238185d3567643e84f06c4343f470de933c1deffe9e5baf2472abfffbb not found: ID does not exist"
Sep 11 12:34:22.913930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.913908    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:34:22.919060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:22.919041    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798d5554dd-9wg8c"]
Sep 11 12:34:23.876774 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:23.876736    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092c4718-3e73-4606-9522-acc348e02d4c" path="/var/lib/kubelet/pods/092c4718-3e73-4606-9522-acc348e02d4c/volumes"
Sep 11 12:34:28.277729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:28.277694    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:28.376952 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:28.376918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:33.194665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.194635    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"]
Sep 11 12:34:33.195114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.194920    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092c4718-3e73-4606-9522-acc348e02d4c" containerName="console"
Sep 11 12:34:33.195114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.194930    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="092c4718-3e73-4606-9522-acc348e02d4c" containerName="console"
Sep 11 12:34:33.195114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.195006    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="092c4718-3e73-4606-9522-acc348e02d4c" containerName="console"
Sep 11 12:34:33.199517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.199500    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.202515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.202490    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 12:34:33.202515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.202490    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ks7w8\""
Sep 11 12:34:33.203383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.203361    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 12:34:33.207994 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.207970    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"]
Sep 11 12:34:33.292403 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.292376    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"]
Sep 11 12:34:33.292621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.292599    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.292672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.292645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpxgv\" (UniqueName: \"kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.292714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.292697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.295594 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.295579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.304739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.304720    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"]
Sep 11 12:34:33.389068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.389023    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"]
Sep 11 12:34:33.392258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.392241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.393792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.393766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.393887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.393825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.393955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.393891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.394020 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.393952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.394020 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.394014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpxgv\" (UniqueName: \"kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.394144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.394052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskf4\" (UniqueName: \"kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.394186 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.394143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.394221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.394195    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.402560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.402533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpxgv\" (UniqueName: \"kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.414812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.414787    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"]
Sep 11 12:34:33.494357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494327    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.494477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zskf4\" (UniqueName: \"kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.494477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494399    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.494477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.494603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjcg\" (UniqueName: \"kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.494646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.494803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494785    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.494844 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.494837    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.502799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.502770    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"]
Sep 11 12:34:33.506443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.506426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.508378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.508358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:33.512400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.512383    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zskf4\" (UniqueName: \"kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.518581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.518560    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"]
Sep 11 12:34:33.595299 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxt9h\" (UniqueName: \"kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.595417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.595417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.595417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595413    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.595533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.595533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjcg\" (UniqueName: \"kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.595764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595739    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.595804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.595764    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.604045 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.604010    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:33.604383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.604364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjcg\" (UniqueName: \"kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.696405 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.696372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxt9h\" (UniqueName: \"kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.696517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.696414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.696517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.696451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.696778 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.696763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.696822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.696805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.700320 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.700306    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:33.705526 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.705501    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxt9h\" (UniqueName: \"kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.800123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.800102    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"]
Sep 11 12:34:33.802073 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:33.802048    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617153c9_00f6_4983_aae7_1a96c129853a.slice/crio-eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b WatchSource:0}: Error finding container eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b: Status 404 returned error can't find the container with id eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b
Sep 11 12:34:33.830584 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.830564    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:33.892970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.892941    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"]
Sep 11 12:34:33.895961 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:33.895917    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3239d8_0d97_4b22_91f3_6282eaa3706a.slice/crio-db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824 WatchSource:0}: Error finding container db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824: Status 404 returned error can't find the container with id db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824
Sep 11 12:34:33.943767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.943737    2584 generic.go:356] "Generic (PLEG): container finished" podID="617153c9-00f6-4983-aae7-1a96c129853a" containerID="eabf33b0bf547be5a2395c7c100210926055b499ac8f131ee6a8405cc91ecfe2" exitCode=0
Sep 11 12:34:33.943865 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.943832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn" event={"ID":"617153c9-00f6-4983-aae7-1a96c129853a","Type":"ContainerDied","Data":"eabf33b0bf547be5a2395c7c100210926055b499ac8f131ee6a8405cc91ecfe2"}
Sep 11 12:34:33.943931 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.943875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn" event={"ID":"617153c9-00f6-4983-aae7-1a96c129853a","Type":"ContainerStarted","Data":"eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b"}
Sep 11 12:34:33.945159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.945118    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb" event={"ID":"6d3239d8-0d97-4b22-91f3-6282eaa3706a","Type":"ContainerStarted","Data":"db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824"}
Sep 11 12:34:33.972236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:33.972215    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"]
Sep 11 12:34:33.974931 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:33.974900    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94979175_3bf7_4a6a_8743_c6c47edd3a80.slice/crio-8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174 WatchSource:0}: Error finding container 8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174: Status 404 returned error can't find the container with id 8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174
Sep 11 12:34:34.106016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.105988    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"]
Sep 11 12:34:34.145792 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:34.145764    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746ee717_d79f_4b07_9d3d_feb05b594bab.slice/crio-76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21 WatchSource:0}: Error finding container 76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21: Status 404 returned error can't find the container with id 76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21
Sep 11 12:34:34.950885 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.950848    2584 generic.go:356] "Generic (PLEG): container finished" podID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerID="bdd0c78ed56fccd9b5a0223e2ad1ecbfa30883678409bd6c4d6842e21e3cd174" exitCode=0
Sep 11 12:34:34.951343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.950939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52" event={"ID":"746ee717-d79f-4b07-9d3d-feb05b594bab","Type":"ContainerDied","Data":"bdd0c78ed56fccd9b5a0223e2ad1ecbfa30883678409bd6c4d6842e21e3cd174"}
Sep 11 12:34:34.951343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.951007    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52" event={"ID":"746ee717-d79f-4b07-9d3d-feb05b594bab","Type":"ContainerStarted","Data":"76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21"}
Sep 11 12:34:34.952973 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.952954    2584 generic.go:356] "Generic (PLEG): container finished" podID="617153c9-00f6-4983-aae7-1a96c129853a" containerID="10706a0d1284a670ff7ea881f103a31fc46cf774f56a6b1f649826c15a360ee7" exitCode=0
Sep 11 12:34:34.953125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.953047    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn" event={"ID":"617153c9-00f6-4983-aae7-1a96c129853a","Type":"ContainerDied","Data":"10706a0d1284a670ff7ea881f103a31fc46cf774f56a6b1f649826c15a360ee7"}
Sep 11 12:34:34.954645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.954622    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerID="6df5e7fb86e5559587b7a1f50ecbf8947a8349ed43b379c74d280f8fae67de72" exitCode=0
Sep 11 12:34:34.954738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.954664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb" event={"ID":"6d3239d8-0d97-4b22-91f3-6282eaa3706a","Type":"ContainerDied","Data":"6df5e7fb86e5559587b7a1f50ecbf8947a8349ed43b379c74d280f8fae67de72"}
Sep 11 12:34:34.956568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.956550    2584 generic.go:356] "Generic (PLEG): container finished" podID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerID="3f344ffe20d1b7f35de88025bb60deeb72af080039423b1569d08599fd4ce750" exitCode=0
Sep 11 12:34:34.956648 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.956575    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7" event={"ID":"94979175-3bf7-4a6a-8743-c6c47edd3a80","Type":"ContainerDied","Data":"3f344ffe20d1b7f35de88025bb60deeb72af080039423b1569d08599fd4ce750"}
Sep 11 12:34:34.956648 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:34.956599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7" event={"ID":"94979175-3bf7-4a6a-8743-c6c47edd3a80","Type":"ContainerStarted","Data":"8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174"}
Sep 11 12:34:35.963529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:35.963505    2584 generic.go:356] "Generic (PLEG): container finished" podID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerID="38e473feec8147efad2c5882881b30c75d550a9260d8cc3c965d1b5ad04a7f54" exitCode=0
Sep 11 12:34:35.963857 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:35.963582    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52" event={"ID":"746ee717-d79f-4b07-9d3d-feb05b594bab","Type":"ContainerDied","Data":"38e473feec8147efad2c5882881b30c75d550a9260d8cc3c965d1b5ad04a7f54"}
Sep 11 12:34:35.966198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:35.966176    2584 generic.go:356] "Generic (PLEG): container finished" podID="617153c9-00f6-4983-aae7-1a96c129853a" containerID="486c5dfb01579f53ef1084e01e1f52a2cda83e42f51f562bc2705e3cd4b24e5b" exitCode=0
Sep 11 12:34:35.966307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:35.966250    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn" event={"ID":"617153c9-00f6-4983-aae7-1a96c129853a","Type":"ContainerDied","Data":"486c5dfb01579f53ef1084e01e1f52a2cda83e42f51f562bc2705e3cd4b24e5b"}
Sep 11 12:34:36.975710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:36.975676    2584 generic.go:356] "Generic (PLEG): container finished" podID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerID="20ea3337265fff11ebab3f49a08107c892c9397f9eb77cb1c948dbebfc478524" exitCode=0
Sep 11 12:34:36.976146 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:36.975764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7" event={"ID":"94979175-3bf7-4a6a-8743-c6c47edd3a80","Type":"ContainerDied","Data":"20ea3337265fff11ebab3f49a08107c892c9397f9eb77cb1c948dbebfc478524"}
Sep 11 12:34:36.978042 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:36.978005    2584 generic.go:356] "Generic (PLEG): container finished" podID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerID="715b97ce4a0599d6358edf76e8e5468e92a6999d6f1e049cf80a4df0f9706073" exitCode=0
Sep 11 12:34:36.978142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:36.978065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52" event={"ID":"746ee717-d79f-4b07-9d3d-feb05b594bab","Type":"ContainerDied","Data":"715b97ce4a0599d6358edf76e8e5468e92a6999d6f1e049cf80a4df0f9706073"}
Sep 11 12:34:37.109586 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.109486    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:37.121231 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.121206    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpxgv\" (UniqueName: \"kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv\") pod \"617153c9-00f6-4983-aae7-1a96c129853a\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") "
Sep 11 12:34:37.121352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.121240    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util\") pod \"617153c9-00f6-4983-aae7-1a96c129853a\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") "
Sep 11 12:34:37.121352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.121282    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle\") pod \"617153c9-00f6-4983-aae7-1a96c129853a\" (UID: \"617153c9-00f6-4983-aae7-1a96c129853a\") "
Sep 11 12:34:37.121831 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.121800    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle" (OuterVolumeSpecName: "bundle") pod "617153c9-00f6-4983-aae7-1a96c129853a" (UID: "617153c9-00f6-4983-aae7-1a96c129853a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:37.123174 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.123148    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv" (OuterVolumeSpecName: "kube-api-access-cpxgv") pod "617153c9-00f6-4983-aae7-1a96c129853a" (UID: "617153c9-00f6-4983-aae7-1a96c129853a"). InnerVolumeSpecName "kube-api-access-cpxgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:34:37.127117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.127061    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util" (OuterVolumeSpecName: "util") pod "617153c9-00f6-4983-aae7-1a96c129853a" (UID: "617153c9-00f6-4983-aae7-1a96c129853a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:37.221977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.221933    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:37.221977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.221974    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/617153c9-00f6-4983-aae7-1a96c129853a-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:37.221977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.221989    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpxgv\" (UniqueName: \"kubernetes.io/projected/617153c9-00f6-4983-aae7-1a96c129853a-kube-api-access-cpxgv\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:37.983868 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.983836    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn"
Sep 11 12:34:37.983868 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.983865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnghsn" event={"ID":"617153c9-00f6-4983-aae7-1a96c129853a","Type":"ContainerDied","Data":"eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b"}
Sep 11 12:34:37.984320 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.983904    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb7df4c862f71705f58ff1674a991d3678a4dc17ce2e9b9bb0123d8ca17a737b"
Sep 11 12:34:37.986254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.986230    2584 generic.go:356] "Generic (PLEG): container finished" podID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerID="4b66a1cb344bac65f1dab91213400a228a2af6f52590bf0dfa99354cef53d320" exitCode=0
Sep 11 12:34:37.986382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:37.986296    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7" event={"ID":"94979175-3bf7-4a6a-8743-c6c47edd3a80","Type":"ContainerDied","Data":"4b66a1cb344bac65f1dab91213400a228a2af6f52590bf0dfa99354cef53d320"}
Sep 11 12:34:38.112845 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.112821    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:38.127406 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.127389    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle\") pod \"746ee717-d79f-4b07-9d3d-feb05b594bab\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") "
Sep 11 12:34:38.127470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.127423    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxt9h\" (UniqueName: \"kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h\") pod \"746ee717-d79f-4b07-9d3d-feb05b594bab\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") "
Sep 11 12:34:38.127513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.127473    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util\") pod \"746ee717-d79f-4b07-9d3d-feb05b594bab\" (UID: \"746ee717-d79f-4b07-9d3d-feb05b594bab\") "
Sep 11 12:34:38.127824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.127800    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle" (OuterVolumeSpecName: "bundle") pod "746ee717-d79f-4b07-9d3d-feb05b594bab" (UID: "746ee717-d79f-4b07-9d3d-feb05b594bab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:38.129391 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.129363    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h" (OuterVolumeSpecName: "kube-api-access-cxt9h") pod "746ee717-d79f-4b07-9d3d-feb05b594bab" (UID: "746ee717-d79f-4b07-9d3d-feb05b594bab"). InnerVolumeSpecName "kube-api-access-cxt9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:34:38.132846 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.132787    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util" (OuterVolumeSpecName: "util") pod "746ee717-d79f-4b07-9d3d-feb05b594bab" (UID: "746ee717-d79f-4b07-9d3d-feb05b594bab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:38.228160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.228132    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxt9h\" (UniqueName: \"kubernetes.io/projected/746ee717-d79f-4b07-9d3d-feb05b594bab-kube-api-access-cxt9h\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:38.228160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.228157    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:38.228160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.228167    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/746ee717-d79f-4b07-9d3d-feb05b594bab-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:38.993260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.993215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52" event={"ID":"746ee717-d79f-4b07-9d3d-feb05b594bab","Type":"ContainerDied","Data":"76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21"}
Sep 11 12:34:38.993624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.993279    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ac3b85002cca01fa9f04a0994f01339d081cd5c4818a4c4efb36a2747eeb21"
Sep 11 12:34:38.993624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:38.993238    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64bf52"
Sep 11 12:34:39.112516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.112493    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:39.135233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.135209    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcjcg\" (UniqueName: \"kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg\") pod \"94979175-3bf7-4a6a-8743-c6c47edd3a80\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") "
Sep 11 12:34:39.135354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.135259    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util\") pod \"94979175-3bf7-4a6a-8743-c6c47edd3a80\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") "
Sep 11 12:34:39.135354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.135293    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle\") pod \"94979175-3bf7-4a6a-8743-c6c47edd3a80\" (UID: \"94979175-3bf7-4a6a-8743-c6c47edd3a80\") "
Sep 11 12:34:39.136075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.136047    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle" (OuterVolumeSpecName: "bundle") pod "94979175-3bf7-4a6a-8743-c6c47edd3a80" (UID: "94979175-3bf7-4a6a-8743-c6c47edd3a80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:39.137187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.137162    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg" (OuterVolumeSpecName: "kube-api-access-xcjcg") pod "94979175-3bf7-4a6a-8743-c6c47edd3a80" (UID: "94979175-3bf7-4a6a-8743-c6c47edd3a80"). InnerVolumeSpecName "kube-api-access-xcjcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:34:39.143956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.143927    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util" (OuterVolumeSpecName: "util") pod "94979175-3bf7-4a6a-8743-c6c47edd3a80" (UID: "94979175-3bf7-4a6a-8743-c6c47edd3a80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:39.236526 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.236495    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcjcg\" (UniqueName: \"kubernetes.io/projected/94979175-3bf7-4a6a-8743-c6c47edd3a80-kube-api-access-xcjcg\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:39.236526 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.236523    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:39.236653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.236541    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94979175-3bf7-4a6a-8743-c6c47edd3a80-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:39.999951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.999924    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7"
Sep 11 12:34:39.999951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.999932    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akm7n7" event={"ID":"94979175-3bf7-4a6a-8743-c6c47edd3a80","Type":"ContainerDied","Data":"8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174"}
Sep 11 12:34:40.000352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:39.999972    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e03304be0a6508c1abe6129c50efe9d6866c20707d45d86ab14d9144ce4c174"
Sep 11 12:34:42.012343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:42.012313    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerID="baee75e7efc751787105d8ea3e6a5a54a9bbae7aaab54fe1211a4ade2fbf94fd" exitCode=0
Sep 11 12:34:42.012782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:42.012396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb" event={"ID":"6d3239d8-0d97-4b22-91f3-6282eaa3706a","Type":"ContainerDied","Data":"baee75e7efc751787105d8ea3e6a5a54a9bbae7aaab54fe1211a4ade2fbf94fd"}
Sep 11 12:34:43.019269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:43.019232    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerID="590ec27daea2c09fa19720bf473800a9189e48a2c41c0b2f6071951b0d5df917" exitCode=0
Sep 11 12:34:43.019637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:43.019273    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb" event={"ID":"6d3239d8-0d97-4b22-91f3-6282eaa3706a","Type":"ContainerDied","Data":"590ec27daea2c09fa19720bf473800a9189e48a2c41c0b2f6071951b0d5df917"}
Sep 11 12:34:44.153636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.153612    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:44.171554 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.171529    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle\") pod \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") "
Sep 11 12:34:44.171663 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.171592    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zskf4\" (UniqueName: \"kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4\") pod \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") "
Sep 11 12:34:44.171663 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.171619    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util\") pod \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\" (UID: \"6d3239d8-0d97-4b22-91f3-6282eaa3706a\") "
Sep 11 12:34:44.172132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.172104    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle" (OuterVolumeSpecName: "bundle") pod "6d3239d8-0d97-4b22-91f3-6282eaa3706a" (UID: "6d3239d8-0d97-4b22-91f3-6282eaa3706a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:44.173598 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.173564    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4" (OuterVolumeSpecName: "kube-api-access-zskf4") pod "6d3239d8-0d97-4b22-91f3-6282eaa3706a" (UID: "6d3239d8-0d97-4b22-91f3-6282eaa3706a"). InnerVolumeSpecName "kube-api-access-zskf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:34:44.176519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.176484    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util" (OuterVolumeSpecName: "util") pod "6d3239d8-0d97-4b22-91f3-6282eaa3706a" (UID: "6d3239d8-0d97-4b22-91f3-6282eaa3706a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:34:44.272758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.272728    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zskf4\" (UniqueName: \"kubernetes.io/projected/6d3239d8-0d97-4b22-91f3-6282eaa3706a-kube-api-access-zskf4\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:44.272758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.272754    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-util\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:44.272758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:44.272765    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3239d8-0d97-4b22-91f3-6282eaa3706a-bundle\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:34:45.032215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:45.032184    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb" event={"ID":"6d3239d8-0d97-4b22-91f3-6282eaa3706a","Type":"ContainerDied","Data":"db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824"}
Sep 11 12:34:45.032385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:45.032233    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db0048ffc92126109b562a109e71dca42e513c0f94274681518058cfc7c8f824"
Sep 11 12:34:45.032385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:45.032194    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7tq7zb"
Sep 11 12:34:52.207251 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:52.207214    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:54.249618 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249585    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"]
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249887    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="util"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249899    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="util"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249909    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="util"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249915    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="util"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249922    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249928    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249933    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249939    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249946    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249951    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249960    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249964    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249972    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249977    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="extract"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249988    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249992    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="pull"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.249999    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="util"
Sep 11 12:34:54.249996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250004    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="util"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250010    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="util"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250015    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="util"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250020    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="pull"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250038    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="pull"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250045    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="extract"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250049    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="extract"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250095    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="746ee717-d79f-4b07-9d3d-feb05b594bab" containerName="extract"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250101    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3239d8-0d97-4b22-91f3-6282eaa3706a" containerName="extract"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250107    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="617153c9-00f6-4983-aae7-1a96c129853a" containerName="extract"
Sep 11 12:34:54.250684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.250114    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="94979175-3bf7-4a6a-8743-c6c47edd3a80" containerName="extract"
Sep 11 12:34:54.254345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.254327    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:54.258188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.258168    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m2qfm\""
Sep 11 12:34:54.259227 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.259207    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 12:34:54.259307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.259274    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 12:34:54.265630 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.265613    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 12:34:54.276264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.276244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"]
Sep 11 12:34:54.351671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.351637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5cz\" (UniqueName: \"kubernetes.io/projected/607f683f-430f-461d-80ff-6ead2000ce0f-kube-api-access-kr5cz\") pod \"dns-operator-controller-manager-7b84cd7c9c-qzdns\" (UID: \"607f683f-430f-461d-80ff-6ead2000ce0f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:54.452924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.452884    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5cz\" (UniqueName: \"kubernetes.io/projected/607f683f-430f-461d-80ff-6ead2000ce0f-kube-api-access-kr5cz\") pod \"dns-operator-controller-manager-7b84cd7c9c-qzdns\" (UID: \"607f683f-430f-461d-80ff-6ead2000ce0f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:54.470882 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.470847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5cz\" (UniqueName: \"kubernetes.io/projected/607f683f-430f-461d-80ff-6ead2000ce0f-kube-api-access-kr5cz\") pod \"dns-operator-controller-manager-7b84cd7c9c-qzdns\" (UID: \"607f683f-430f-461d-80ff-6ead2000ce0f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:54.564214 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.564127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:54.853658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.853634    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"]
Sep 11 12:34:54.855749 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:54.855722    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607f683f_430f_461d_80ff_6ead2000ce0f.slice/crio-2e57e8bf25c46cf8af107232de54487dabae32613a436e2d6ae47884047ccf7a WatchSource:0}: Error finding container 2e57e8bf25c46cf8af107232de54487dabae32613a436e2d6ae47884047ccf7a: Status 404 returned error can't find the container with id 2e57e8bf25c46cf8af107232de54487dabae32613a436e2d6ae47884047ccf7a
Sep 11 12:34:54.887498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:54.887473    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:55.080538 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:55.080492    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns" event={"ID":"607f683f-430f-461d-80ff-6ead2000ce0f","Type":"ContainerStarted","Data":"2e57e8bf25c46cf8af107232de54487dabae32613a436e2d6ae47884047ccf7a"}
Sep 11 12:34:55.207150 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:55.207067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:55.607266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:55.607227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:56.860904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:56.860861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:58.099711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.099669    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns" event={"ID":"607f683f-430f-461d-80ff-6ead2000ce0f","Type":"ContainerStarted","Data":"5cb84f23dadf6f85f4ef75e579dd541a3d4172ac14085299e801b5736214109f"}
Sep 11 12:34:58.100096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.099795    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:34:58.126789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.126740    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns" podStartSLOduration=1.935598363 podStartE2EDuration="4.126726498s" totalImagesPullingTime="2.191128135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:34:58.124814169 +0000 UTC m=+490.768706827" watchObservedRunningTime="2026-09-11 12:34:58.126726498 +0000 UTC m=+490.770619156"
Sep 11 12:34:58.848518 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.848483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:58.940320 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.940265    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"]
Sep 11 12:34:58.943632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.943609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:58.948525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.948506    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7j69\""
Sep 11 12:34:58.963147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.963123    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"]
Sep 11 12:34:58.981940 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.981914    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:58.998508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.998476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:58.998508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:58.998508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spssx\" (UniqueName: \"kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.099324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.099227    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.099324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.099267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spssx\" (UniqueName: \"kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.099629 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.099605    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.124071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.124047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spssx\" (UniqueName: \"kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.226833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.226779    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:34:59.252812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.252777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:34:59.530821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:34:59.530795    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"]
Sep 11 12:34:59.532829 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:34:59.532799    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb38c278_ec40_4d27_b23a_fdf2937105aa.slice/crio-75a15c77f66b92fecd0d829919d31d0bb8cfa3db0d962dfd7b4abf8487648f51 WatchSource:0}: Error finding container 75a15c77f66b92fecd0d829919d31d0bb8cfa3db0d962dfd7b4abf8487648f51: Status 404 returned error can't find the container with id 75a15c77f66b92fecd0d829919d31d0bb8cfa3db0d962dfd7b4abf8487648f51
Sep 11 12:35:00.110553 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.110514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g" event={"ID":"cb38c278-ec40-4d27-b23a-fdf2937105aa","Type":"ContainerStarted","Data":"75a15c77f66b92fecd0d829919d31d0bb8cfa3db0d962dfd7b4abf8487648f51"}
Sep 11 12:35:00.755230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.755194    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"]
Sep 11 12:35:00.759922 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.759905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:00.765153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.765127    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-q6r6n\""
Sep 11 12:35:00.774107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.774082    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"]
Sep 11 12:35:00.813702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.813671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgnmb\" (UniqueName: \"kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb\") pod \"limitador-operator-controller-manager-74495c69f8-w6hj5\" (UID: \"3f362a1f-32b5-4934-9505-d7990bb7b145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:00.914552 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.914509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgnmb\" (UniqueName: \"kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb\") pod \"limitador-operator-controller-manager-74495c69f8-w6hj5\" (UID: \"3f362a1f-32b5-4934-9505-d7990bb7b145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:00.923970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:00.923943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgnmb\" (UniqueName: \"kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb\") pod \"limitador-operator-controller-manager-74495c69f8-w6hj5\" (UID: \"3f362a1f-32b5-4934-9505-d7990bb7b145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:01.022604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:01.022517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:01.070012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:01.069986    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:01.258840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:01.258811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:01.350537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:01.350436    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"]
Sep 11 12:35:01.352739 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:01.352714    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f362a1f_32b5_4934_9505_d7990bb7b145.slice/crio-da89fdbe56600f05e221e08721f25cde9448ee8948e4fad893fb8f7784229b92 WatchSource:0}: Error finding container da89fdbe56600f05e221e08721f25cde9448ee8948e4fad893fb8f7784229b92: Status 404 returned error can't find the container with id da89fdbe56600f05e221e08721f25cde9448ee8948e4fad893fb8f7784229b92
Sep 11 12:35:01.405406 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:01.405372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:02.124532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:02.124490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5" event={"ID":"3f362a1f-32b5-4934-9505-d7990bb7b145","Type":"ContainerStarted","Data":"da89fdbe56600f05e221e08721f25cde9448ee8948e4fad893fb8f7784229b92"}
Sep 11 12:35:03.136495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.136452    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5" event={"ID":"3f362a1f-32b5-4934-9505-d7990bb7b145","Type":"ContainerStarted","Data":"132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70"}
Sep 11 12:35:03.136929 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.136532    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:03.182424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.182326    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5" podStartSLOduration=1.622246751 podStartE2EDuration="3.182307129s" totalImagesPullingTime="1.560060378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:03.180248206 +0000 UTC m=+495.824140864" watchObservedRunningTime="2026-09-11 12:35:03.182307129 +0000 UTC m=+495.826199787"
Sep 11 12:35:03.502662 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.502625    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:03.688261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.688223    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p4ttl"]
Sep 11 12:35:03.691852 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.691826    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:03.695071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.695046    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h9nd9\""
Sep 11 12:35:03.705062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.705013    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p4ttl"]
Sep 11 12:35:03.738550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.738521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgvm\" (UniqueName: \"kubernetes.io/projected/ed763175-dc76-4603-ba43-25e5a8bd3321-kube-api-access-hwgvm\") pod \"authorino-operator-76b478bd78-p4ttl\" (UID: \"ed763175-dc76-4603-ba43-25e5a8bd3321\") " pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:03.839885 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.839809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgvm\" (UniqueName: \"kubernetes.io/projected/ed763175-dc76-4603-ba43-25e5a8bd3321-kube-api-access-hwgvm\") pod \"authorino-operator-76b478bd78-p4ttl\" (UID: \"ed763175-dc76-4603-ba43-25e5a8bd3321\") " pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:03.853226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:03.853200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgvm\" (UniqueName: \"kubernetes.io/projected/ed763175-dc76-4603-ba43-25e5a8bd3321-kube-api-access-hwgvm\") pod \"authorino-operator-76b478bd78-p4ttl\" (UID: \"ed763175-dc76-4603-ba43-25e5a8bd3321\") " pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:04.004536 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:04.004496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:04.297179 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:04.297146    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p4ttl"]
Sep 11 12:35:04.299148 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:04.299115    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded763175_dc76_4603_ba43_25e5a8bd3321.slice/crio-0f006c1dd3319cee3bc0e8f20aae7909da2506aa1141588555aede3b86c56946 WatchSource:0}: Error finding container 0f006c1dd3319cee3bc0e8f20aae7909da2506aa1141588555aede3b86c56946: Status 404 returned error can't find the container with id 0f006c1dd3319cee3bc0e8f20aae7909da2506aa1141588555aede3b86c56946
Sep 11 12:35:05.031876 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:05.031841    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:05.131817 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:05.131784    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:05.151799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:05.151664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl" event={"ID":"ed763175-dc76-4603-ba43-25e5a8bd3321","Type":"ContainerStarted","Data":"0f006c1dd3319cee3bc0e8f20aae7909da2506aa1141588555aede3b86c56946"}
Sep 11 12:35:06.158117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:06.158077    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g" event={"ID":"cb38c278-ec40-4d27-b23a-fdf2937105aa","Type":"ContainerStarted","Data":"c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508"}
Sep 11 12:35:06.158471 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:06.158234    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:06.184940 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:06.184892    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g" podStartSLOduration=1.755327335 podStartE2EDuration="8.184875078s" totalImagesPullingTime="6.429547743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:06.183095404 +0000 UTC m=+498.826988063" watchObservedRunningTime="2026-09-11 12:35:06.184875078 +0000 UTC m=+498.828767736"
Sep 11 12:35:07.165173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:07.165140    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl" event={"ID":"ed763175-dc76-4603-ba43-25e5a8bd3321","Type":"ContainerStarted","Data":"907e3f7969b2b794a1aed05299b7954e894ac0e9e5d009b2780e27a27f91c1b3"}
Sep 11 12:35:07.165549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:07.165369    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:07.188477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:07.188432    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl" podStartSLOduration=1.4462406159999999 podStartE2EDuration="4.188417054s" totalImagesPullingTime="2.742176438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:07.186553413 +0000 UTC m=+499.830446073" watchObservedRunningTime="2026-09-11 12:35:07.188417054 +0000 UTC m=+499.832309712"
Sep 11 12:35:08.628344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.628310    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"]
Sep 11 12:35:08.633191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.633166    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.633515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.633486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:08.636137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.636114    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 12:35:08.636244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.636144    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 12:35:08.636244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.636121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-758qr\""
Sep 11 12:35:08.641198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.641174    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"]
Sep 11 12:35:08.780793 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.780761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eee0dd69-a0ba-4add-9746-794d09431e72-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.780968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.780802    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vk8t\" (UniqueName: \"kubernetes.io/projected/eee0dd69-a0ba-4add-9746-794d09431e72-kube-api-access-7vk8t\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.780968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.780873    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.882223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.882142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.882223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.882189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eee0dd69-a0ba-4add-9746-794d09431e72-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.882400 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:08.882282    2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 12:35:08.882400 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:08.882341    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert podName:eee0dd69-a0ba-4add-9746-794d09431e72 nodeName:}" failed. No retries permitted until 2026-09-11 12:35:09.382326218 +0000 UTC m=+502.026218854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-b882f" (UID: "eee0dd69-a0ba-4add-9746-794d09431e72") : secret "plugin-serving-cert" not found
Sep 11 12:35:08.882477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.882423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vk8t\" (UniqueName: \"kubernetes.io/projected/eee0dd69-a0ba-4add-9746-794d09431e72-kube-api-access-7vk8t\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.882867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.882849    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eee0dd69-a0ba-4add-9746-794d09431e72-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:08.891627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:08.891600    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vk8t\" (UniqueName: \"kubernetes.io/projected/eee0dd69-a0ba-4add-9746-794d09431e72-kube-api-access-7vk8t\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:09.054333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.054304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:09.106105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.106077    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-qzdns"
Sep 11 12:35:09.385890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.385822    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:09.388563 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.388536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eee0dd69-a0ba-4add-9746-794d09431e72-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b882f\" (UID: \"eee0dd69-a0ba-4add-9746-794d09431e72\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:09.542393 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.542361    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"
Sep 11 12:35:09.820381 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.820355    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f"]
Sep 11 12:35:09.822183 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:09.822154    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeee0dd69_a0ba_4add_9746_794d09431e72.slice/crio-1a2f3da65181286048d2bdc84fefc5d7cc8725318816c7487da1c08850ed180c WatchSource:0}: Error finding container 1a2f3da65181286048d2bdc84fefc5d7cc8725318816c7487da1c08850ed180c: Status 404 returned error can't find the container with id 1a2f3da65181286048d2bdc84fefc5d7cc8725318816c7487da1c08850ed180c
Sep 11 12:35:09.841815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.841784    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:09.942719 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:09.942690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:10.044099 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:10.044067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:10.142502 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:10.142432    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:10.181818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:10.181793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f" event={"ID":"eee0dd69-a0ba-4add-9746-794d09431e72","Type":"ContainerStarted","Data":"1a2f3da65181286048d2bdc84fefc5d7cc8725318816c7487da1c08850ed180c"}
Sep 11 12:35:10.242670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:10.242645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:10.356149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:10.356119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:14.145979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:14.145956    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:14.205845 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:14.205800    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f" event={"ID":"eee0dd69-a0ba-4add-9746-794d09431e72","Type":"ContainerStarted","Data":"7d88b4acdc89410a17e124952f209d0bdec6df4bed68abd654d57b06ba9712f0"}
Sep 11 12:35:14.226813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:14.226761    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b882f" podStartSLOduration=1.942864618 podStartE2EDuration="6.226742475s" totalImagesPullingTime="4.283877857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:14.224709041 +0000 UTC m=+506.868601700" watchObservedRunningTime="2026-09-11 12:35:14.226742475 +0000 UTC m=+506.870635181"
Sep 11 12:35:16.695318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:16.695282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:16.796665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:16.796632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:17.167656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:17.167628    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:18.172117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:18.172086    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-p4ttl"
Sep 11 12:35:19.452519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.452480    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"]
Sep 11 12:35:19.453022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.452711    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" containerName="manager" containerID="cri-o://c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508" gracePeriod=2
Sep 11 12:35:19.455700 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.455673    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"]
Sep 11 12:35:19.470736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.470579    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"]
Sep 11 12:35:19.470823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.470803    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" containerName="manager" containerID="cri-o://132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70" gracePeriod=2
Sep 11 12:35:19.474094 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.474056    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.486529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.486487    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"]
Sep 11 12:35:19.493500 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.493458    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3f362a1f-32b5-4934-9505-d7990bb7b145\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-w6hj5\": pods \"limitador-operator-controller-manager-74495c69f8-w6hj5\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.498450 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498426    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:19.498736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498725    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" containerName="manager"
Sep 11 12:35:19.498802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498737    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" containerName="manager"
Sep 11 12:35:19.498802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498761    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" containerName="manager"
Sep 11 12:35:19.498802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498766    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" containerName="manager"
Sep 11 12:35:19.498958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498816    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" containerName="manager"
Sep 11 12:35:19.498958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.498825    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" containerName="manager"
Sep 11 12:35:19.501735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.501718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.504397 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.504371    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.506681 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.506655    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-w6hj5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.512914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.512889    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"]
Sep 11 12:35:19.516190 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.516166    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:19.522049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.522012    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:19.526760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.526736    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"]
Sep 11 12:35:19.556133 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.556095    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.559007 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.558977    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-w6hj5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.571751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.571724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.571886 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.571784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q8wg\" (UniqueName: \"kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.672598 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.672565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.672772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.672631    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q8wg\" (UniqueName: \"kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.672772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.672688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnb8r\" (UniqueName: \"kubernetes.io/projected/f58022c2-0212-40bd-9742-c99ee89bb047-kube-api-access-qnb8r\") pod \"limitador-operator-controller-manager-74495c69f8-cqpzd\" (UID: \"f58022c2-0212-40bd-9742-c99ee89bb047\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:19.672955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.672933    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.687013 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.686984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q8wg\" (UniqueName: \"kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xsbpn\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.715067 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.715015    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 12:35:19.718601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.718583    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.720437 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.720418    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.723383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.723365    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.723951 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.723928    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.726807 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.726783    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-w6hj5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.741366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.741343    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 12:35:19.760054 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.760009    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wxh9g\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:19.762615 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:19.762583    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-w6hj5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:19.774039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.774008    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnb8r\" (UniqueName: \"kubernetes.io/projected/f58022c2-0212-40bd-9742-c99ee89bb047-kube-api-access-qnb8r\") pod \"limitador-operator-controller-manager-74495c69f8-cqpzd\" (UID: \"f58022c2-0212-40bd-9742-c99ee89bb047\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:19.789641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.789615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnb8r\" (UniqueName: \"kubernetes.io/projected/f58022c2-0212-40bd-9742-c99ee89bb047-kube-api-access-qnb8r\") pod \"limitador-operator-controller-manager-74495c69f8-cqpzd\" (UID: \"f58022c2-0212-40bd-9742-c99ee89bb047\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:19.874591 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.874563    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume\") pod \"cb38c278-ec40-4d27-b23a-fdf2937105aa\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") "
Sep 11 12:35:19.874736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.874611    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgnmb\" (UniqueName: \"kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb\") pod \"3f362a1f-32b5-4934-9505-d7990bb7b145\" (UID: \"3f362a1f-32b5-4934-9505-d7990bb7b145\") "
Sep 11 12:35:19.874736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.874686    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spssx\" (UniqueName: \"kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx\") pod \"cb38c278-ec40-4d27-b23a-fdf2937105aa\" (UID: \"cb38c278-ec40-4d27-b23a-fdf2937105aa\") "
Sep 11 12:35:19.874863 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.874811    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.874926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.874869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wb6\" (UniqueName: \"kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.875135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.875106    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb38c278-ec40-4d27-b23a-fdf2937105aa" (UID: "cb38c278-ec40-4d27-b23a-fdf2937105aa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:35:19.876865 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.876836    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx" (OuterVolumeSpecName: "kube-api-access-spssx") pod "cb38c278-ec40-4d27-b23a-fdf2937105aa" (UID: "cb38c278-ec40-4d27-b23a-fdf2937105aa"). InnerVolumeSpecName "kube-api-access-spssx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:35:19.877117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.877093    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb" (OuterVolumeSpecName: "kube-api-access-vgnmb") pod "3f362a1f-32b5-4934-9505-d7990bb7b145" (UID: "3f362a1f-32b5-4934-9505-d7990bb7b145"). InnerVolumeSpecName "kube-api-access-vgnmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:35:19.877214 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.877196    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb38c278-ec40-4d27-b23a-fdf2937105aa" path="/var/lib/kubelet/pods/cb38c278-ec40-4d27-b23a-fdf2937105aa/volumes"
Sep 11 12:35:19.884841 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.884817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:19.890236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.890215    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:19.976449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.976449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wb6\" (UniqueName: \"kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.976698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976508    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb38c278-ec40-4d27-b23a-fdf2937105aa-extensions-socket-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:35:19.976698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976519    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgnmb\" (UniqueName: \"kubernetes.io/projected/3f362a1f-32b5-4934-9505-d7990bb7b145-kube-api-access-vgnmb\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:35:19.976698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976528    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spssx\" (UniqueName: \"kubernetes.io/projected/cb38c278-ec40-4d27-b23a-fdf2937105aa-kube-api-access-spssx\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:35:19.976885 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.976730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:19.986440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:19.986415    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wb6\" (UniqueName: \"kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zvr6f\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:20.028288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.028259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:20.181663 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.181625    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:20.184565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.184538    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"]
Sep 11 12:35:20.184664 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:20.184580    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58022c2_0212_40bd_9742_c99ee89bb047.slice/crio-ea61757f07cf59570c833b1aa27faf47c9d324b4b7f9f4c85e43309ca9287474 WatchSource:0}: Error finding container ea61757f07cf59570c833b1aa27faf47c9d324b4b7f9f4c85e43309ca9287474: Status 404 returned error can't find the container with id ea61757f07cf59570c833b1aa27faf47c9d324b4b7f9f4c85e43309ca9287474
Sep 11 12:35:20.185439 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:20.185421    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03f94bf_df63_402d_9eb8_9030650d7289.slice/crio-a58a49879e35e976bacfe1ba768f14793b62c590179f4a6ef9546c35eb904188 WatchSource:0}: Error finding container a58a49879e35e976bacfe1ba768f14793b62c590179f4a6ef9546c35eb904188: Status 404 returned error can't find the container with id a58a49879e35e976bacfe1ba768f14793b62c590179f4a6ef9546c35eb904188
Sep 11 12:35:20.242249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.242227    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f362a1f-32b5-4934-9505-d7990bb7b145" containerID="132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70" exitCode=0
Sep 11 12:35:20.242368 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.242294    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w6hj5"
Sep 11 12:35:20.242368 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.242334    2584 scope.go:117] "RemoveContainer" containerID="132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70"
Sep 11 12:35:20.244110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.244093    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wxh9g"
Sep 11 12:35:20.244234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.244158    2584 generic.go:356] "Generic (PLEG): container finished" podID="cb38c278-ec40-4d27-b23a-fdf2937105aa" containerID="c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508" exitCode=0
Sep 11 12:35:20.245898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.245869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd" event={"ID":"f58022c2-0212-40bd-9742-c99ee89bb047","Type":"ContainerStarted","Data":"ea61757f07cf59570c833b1aa27faf47c9d324b4b7f9f4c85e43309ca9287474"}
Sep 11 12:35:20.247775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.247737    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" event={"ID":"e03f94bf-df63-402d-9eb8-9030650d7289","Type":"ContainerStarted","Data":"a58a49879e35e976bacfe1ba768f14793b62c590179f4a6ef9546c35eb904188"}
Sep 11 12:35:20.251840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.251825    2584 scope.go:117] "RemoveContainer" containerID="132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70"
Sep 11 12:35:20.252150 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:20.252120    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70\": container with ID starting with 132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70 not found: ID does not exist" containerID="132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70"
Sep 11 12:35:20.252255 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.252161    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70"} err="failed to get container status \"132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70\": rpc error: code = NotFound desc = could not find container \"132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70\": container with ID starting with 132af5d03ce32e1e3fee38172e469c42292bc43bb09c5b14c20e223e70cfeb70 not found: ID does not exist"
Sep 11 12:35:20.252255 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.252185    2584 scope.go:117] "RemoveContainer" containerID="c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508"
Sep 11 12:35:20.261394 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.261375    2584 scope.go:117] "RemoveContainer" containerID="c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508"
Sep 11 12:35:20.261632 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:20.261612    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508\": container with ID starting with c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508 not found: ID does not exist" containerID="c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508"
Sep 11 12:35:20.261696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.261638    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508"} err="failed to get container status \"c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508\": rpc error: code = NotFound desc = could not find container \"c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508\": container with ID starting with c5aac0606353ab413567238e1d4d456ec23dcfc07b57caba2e1b1e0b48a4f508 not found: ID does not exist"
Sep 11 12:35:20.308508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:20.308451    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 12:35:20.311120 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:20.311091    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46599b0c_67a7_4b95_a397_86a060094958.slice/crio-d6a01608947dc63ddc6581a05b5973cf514330e881d7a766d3f33158cf21a294 WatchSource:0}: Error finding container d6a01608947dc63ddc6581a05b5973cf514330e881d7a766d3f33158cf21a294: Status 404 returned error can't find the container with id d6a01608947dc63ddc6581a05b5973cf514330e881d7a766d3f33158cf21a294
Sep 11 12:35:21.255947 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.255910    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" event={"ID":"46599b0c-67a7-4b95-a397-86a060094958","Type":"ContainerStarted","Data":"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"}
Sep 11 12:35:21.256619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.255960    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" event={"ID":"46599b0c-67a7-4b95-a397-86a060094958","Type":"ContainerStarted","Data":"d6a01608947dc63ddc6581a05b5973cf514330e881d7a766d3f33158cf21a294"}
Sep 11 12:35:21.256619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.256011    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:21.258619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.258593    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd" event={"ID":"f58022c2-0212-40bd-9742-c99ee89bb047","Type":"ContainerStarted","Data":"3b38a966fe7cfed0e04ad881fc7efe62c8e19f2b0410af1f1d0dcdc5860e732d"}
Sep 11 12:35:21.258732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.258642    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:21.260416 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.260395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" event={"ID":"e03f94bf-df63-402d-9eb8-9030650d7289","Type":"ContainerStarted","Data":"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"}
Sep 11 12:35:21.260513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.260463    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:21.284850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.284809    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" podStartSLOduration=2.28479573 podStartE2EDuration="2.28479573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:21.281963633 +0000 UTC m=+513.925856291" watchObservedRunningTime="2026-09-11 12:35:21.28479573 +0000 UTC m=+513.928688382"
Sep 11 12:35:21.341187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.341125    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" podStartSLOduration=2.341103054 podStartE2EDuration="2.341103054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:21.315247519 +0000 UTC m=+513.959140176" watchObservedRunningTime="2026-09-11 12:35:21.341103054 +0000 UTC m=+513.984995714"
Sep 11 12:35:21.341536 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.341501    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd" podStartSLOduration=2.341491684 podStartE2EDuration="2.341491684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:21.34068565 +0000 UTC m=+513.984578309" watchObservedRunningTime="2026-09-11 12:35:21.341491684 +0000 UTC m=+513.985384343"
Sep 11 12:35:21.508997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.508906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:21.610879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.610846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:21.877655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:21.877577    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f362a1f-32b5-4934-9505-d7990bb7b145" path="/var/lib/kubelet/pods/3f362a1f-32b5-4934-9505-d7990bb7b145/volumes"
Sep 11 12:35:24.101378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:24.101343    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:24.203975 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:24.203933    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.462208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.462168    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.562077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.562023    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.671348 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.671315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.744489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.744462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.852419 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.852383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:29.928158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:29.928129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:30.284344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:30.284311    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:30.385516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:30.385483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:32.267665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:32.267634    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-cqpzd"
Sep 11 12:35:32.268139 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:32.267994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:32.268441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:32.268421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 12:35:32.382431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:32.382396    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:32.382637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:32.382611    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" podUID="e03f94bf-df63-402d-9eb8-9030650d7289" containerName="manager" containerID="cri-o://6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e" gracePeriod=10
Sep 11 12:35:33.161847 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.161812    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:33.185880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.185854    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume\") pod \"e03f94bf-df63-402d-9eb8-9030650d7289\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") "
Sep 11 12:35:33.185880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.185893    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q8wg\" (UniqueName: \"kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg\") pod \"e03f94bf-df63-402d-9eb8-9030650d7289\" (UID: \"e03f94bf-df63-402d-9eb8-9030650d7289\") "
Sep 11 12:35:33.186211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.186189    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e03f94bf-df63-402d-9eb8-9030650d7289" (UID: "e03f94bf-df63-402d-9eb8-9030650d7289"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:35:33.187997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.187968    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg" (OuterVolumeSpecName: "kube-api-access-2q8wg") pod "e03f94bf-df63-402d-9eb8-9030650d7289" (UID: "e03f94bf-df63-402d-9eb8-9030650d7289"). InnerVolumeSpecName "kube-api-access-2q8wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:35:33.286475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.286411    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03f94bf-df63-402d-9eb8-9030650d7289-extensions-socket-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:35:33.286475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.286435    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q8wg\" (UniqueName: \"kubernetes.io/projected/e03f94bf-df63-402d-9eb8-9030650d7289-kube-api-access-2q8wg\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:35:33.327261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.327231    2584 generic.go:356] "Generic (PLEG): container finished" podID="e03f94bf-df63-402d-9eb8-9030650d7289" containerID="6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e" exitCode=0
Sep 11 12:35:33.327374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.327278    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"
Sep 11 12:35:33.327374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.327318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" event={"ID":"e03f94bf-df63-402d-9eb8-9030650d7289","Type":"ContainerDied","Data":"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"}
Sep 11 12:35:33.327374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.327371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn" event={"ID":"e03f94bf-df63-402d-9eb8-9030650d7289","Type":"ContainerDied","Data":"a58a49879e35e976bacfe1ba768f14793b62c590179f4a6ef9546c35eb904188"}
Sep 11 12:35:33.327517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.327395    2584 scope.go:117] "RemoveContainer" containerID="6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"
Sep 11 12:35:33.336420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.336404    2584 scope.go:117] "RemoveContainer" containerID="6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"
Sep 11 12:35:33.336712 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:35:33.336690    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e\": container with ID starting with 6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e not found: ID does not exist" containerID="6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"
Sep 11 12:35:33.336785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.336718    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e"} err="failed to get container status \"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e\": rpc error: code = NotFound desc = could not find container \"6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e\": container with ID starting with 6a5704b4ffb36541093d71359284b34e5683dad172497217f1742b5d1b21a19e not found: ID does not exist"
Sep 11 12:35:33.357294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.357268    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:33.363210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.363188    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xsbpn"]
Sep 11 12:35:33.876713 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:33.876681    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e03f94bf-df63-402d-9eb8-9030650d7289" path="/var/lib/kubelet/pods/e03f94bf-df63-402d-9eb8-9030650d7289/volumes"
Sep 11 12:35:36.477850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:36.477805    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:36.592474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:36.592441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:41.273988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:41.273892    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:41.388291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:41.388259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:48.767278 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.767242    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"]
Sep 11 12:35:48.767638 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.767590    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03f94bf-df63-402d-9eb8-9030650d7289" containerName="manager"
Sep 11 12:35:48.767638 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.767603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03f94bf-df63-402d-9eb8-9030650d7289" containerName="manager"
Sep 11 12:35:48.767722 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.767673    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e03f94bf-df63-402d-9eb8-9030650d7289" containerName="manager"
Sep 11 12:35:48.770371 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.770352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.774181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.774158    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bcjpc\""
Sep 11 12:35:48.774836 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.774816    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 12:35:48.788509 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.788486    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"]
Sep 11 12:35:48.789619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789722 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789722 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789648    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789722 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789734    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/509ded33-17ab-44f0-b1b4-b79229f85a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789791    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cz8\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-kube-api-access-c5cz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.789898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789877    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.790183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.789919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.803838 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.803812    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:48.890657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.890625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.890769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.890704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.890769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.890734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.890769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.890753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.890932 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.890774    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891075 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891024    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891090    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/509ded33-17ab-44f0-b1b4-b79229f85a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891049    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891290    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cz8\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-kube-api-access-c5cz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.891822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.891799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/509ded33-17ab-44f0-b1b4-b79229f85a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.893148 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.893125    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.893563 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.893546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.900114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.900093    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:48.900655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:48.900638    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cz8\" (UniqueName: \"kubernetes.io/projected/509ded33-17ab-44f0-b1b4-b79229f85a18-kube-api-access-c5cz8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8pcrm\" (UID: \"509ded33-17ab-44f0-b1b4-b79229f85a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:49.062661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:49.062583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:49.080446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:49.080423    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:49.355727 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:49.355698    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"]
Sep 11 12:35:49.357303 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:49.357276    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509ded33_17ab_44f0_b1b4_b79229f85a18.slice/crio-f8c6aaec41d421bbfbb15a02b3938fcbe847052ec4ba6b52c5d60c6fd934ad70 WatchSource:0}: Error finding container f8c6aaec41d421bbfbb15a02b3938fcbe847052ec4ba6b52c5d60c6fd934ad70: Status 404 returned error can't find the container with id f8c6aaec41d421bbfbb15a02b3938fcbe847052ec4ba6b52c5d60c6fd934ad70
Sep 11 12:35:49.418134 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:49.418107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" event={"ID":"509ded33-17ab-44f0-b1b4-b79229f85a18","Type":"ContainerStarted","Data":"f8c6aaec41d421bbfbb15a02b3938fcbe847052ec4ba6b52c5d60c6fd934ad70"}
Sep 11 12:35:51.801323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:51.801288    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:35:51.801629 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:51.801356    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:35:51.801629 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:51.801412    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:35:52.442201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:52.442167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" event={"ID":"509ded33-17ab-44f0-b1b4-b79229f85a18","Type":"ContainerStarted","Data":"69e154b674afa5368d6e45cf943cc0ca0ecd14a78db9a5ba28b84d3660afbe6f"}
Sep 11 12:35:52.466153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:52.466106    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podStartSLOduration=2.024536539 podStartE2EDuration="4.466092566s" totalImagesPullingTime="2.441556027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:52.464269433 +0000 UTC m=+545.108162091" watchObservedRunningTime="2026-09-11 12:35:52.466092566 +0000 UTC m=+545.109985224"
Sep 11 12:35:53.080965 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.080934    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:53.085662 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.085637    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:53.448147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.448066    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:53.449110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.449083    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:35:53.453059 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.453004    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:53.558879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.558840    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:53.661757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.661721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:53.843552 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.843516    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:35:53.845831 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.845807    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:53.848852 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.848832    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 12:35:53.856910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.856888    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:35:53.879708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.879685    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:35:53.934728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.934700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgdd\" (UniqueName: \"kubernetes.io/projected/28d89956-f9b6-4c6c-a640-ba28a60fc801-kube-api-access-bdgdd\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:53.934844 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:53.934750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28d89956-f9b6-4c6c-a640-ba28a60fc801-config-file\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.035997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.035969    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgdd\" (UniqueName: \"kubernetes.io/projected/28d89956-f9b6-4c6c-a640-ba28a60fc801-kube-api-access-bdgdd\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.036122 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.036020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28d89956-f9b6-4c6c-a640-ba28a60fc801-config-file\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.036622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.036604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28d89956-f9b6-4c6c-a640-ba28a60fc801-config-file\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.046230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.046206    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgdd\" (UniqueName: \"kubernetes.io/projected/28d89956-f9b6-4c6c-a640-ba28a60fc801-kube-api-access-bdgdd\") pod \"limitador-limitador-84994f7ffc-w5dp5\" (UID: \"28d89956-f9b6-4c6c-a640-ba28a60fc801\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.156527 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.156472    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:54.410108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.410005    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:54.432983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.432959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:35:54.434822 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:54.434796    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d89956_f9b6_4c6c_a640_ba28a60fc801.slice/crio-01c0ab5acd95527f2e08ee850adcc056e5d06aa1fba7b5744b649229610fa3b2 WatchSource:0}: Error finding container 01c0ab5acd95527f2e08ee850adcc056e5d06aa1fba7b5744b649229610fa3b2: Status 404 returned error can't find the container with id 01c0ab5acd95527f2e08ee850adcc056e5d06aa1fba7b5744b649229610fa3b2
Sep 11 12:35:54.457223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.457192    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5" event={"ID":"28d89956-f9b6-4c6c-a640-ba28a60fc801","Type":"ContainerStarted","Data":"01c0ab5acd95527f2e08ee850adcc056e5d06aa1fba7b5744b649229610fa3b2"}
Sep 11 12:35:54.515652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.515620    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:35:54.517374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.517354    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:35:54.520168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.520148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:35:54.523477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.523459    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mltk2\""
Sep 11 12:35:54.529548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.529527    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:35:54.640344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.640311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnpsp\" (UniqueName: \"kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp\") pod \"authorino-59c974bd48-chpj9\" (UID: \"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0\") " pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:35:54.741703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.741678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnpsp\" (UniqueName: \"kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp\") pod \"authorino-59c974bd48-chpj9\" (UID: \"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0\") " pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:35:54.751327 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.751296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnpsp\" (UniqueName: \"kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp\") pod \"authorino-59c974bd48-chpj9\" (UID: \"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0\") " pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:35:54.830164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:54.830138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:35:55.112597 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:55.112520    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:35:55.147656 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:35:55.147628    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2640e2d_e6fc_40aa_a1f8_766d674ac0a0.slice/crio-24cf2f0345217581c0c8712cb9131da3fa9f1bd7dd44b514708a5ebd7fb7236f WatchSource:0}: Error finding container 24cf2f0345217581c0c8712cb9131da3fa9f1bd7dd44b514708a5ebd7fb7236f: Status 404 returned error can't find the container with id 24cf2f0345217581c0c8712cb9131da3fa9f1bd7dd44b514708a5ebd7fb7236f
Sep 11 12:35:55.464683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:55.464604    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5" event={"ID":"28d89956-f9b6-4c6c-a640-ba28a60fc801","Type":"ContainerStarted","Data":"269b94e83900ffc7ce42fdd185f9986d52cc1622d448310ae7c75bf343c89e45"}
Sep 11 12:35:55.464683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:55.464667    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:35:55.465872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:55.465847    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-chpj9" event={"ID":"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0","Type":"ContainerStarted","Data":"24cf2f0345217581c0c8712cb9131da3fa9f1bd7dd44b514708a5ebd7fb7236f"}
Sep 11 12:35:55.486276 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:55.486233    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5" podStartSLOduration=1.747522768 podStartE2EDuration="2.486218637s" totalImagesPullingTime="738.695869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:55.486020903 +0000 UTC m=+548.129913561" watchObservedRunningTime="2026-09-11 12:35:55.486218637 +0000 UTC m=+548.130111296"
Sep 11 12:35:57.479354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:57.479267    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-chpj9" event={"ID":"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0","Type":"ContainerStarted","Data":"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"}
Sep 11 12:35:57.502578 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:35:57.502531    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-chpj9" podStartSLOduration=1.6661318440000001 podStartE2EDuration="3.50251765s" totalImagesPullingTime="1.836385806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:57.501832757 +0000 UTC m=+550.145725398" watchObservedRunningTime="2026-09-11 12:35:57.50251765 +0000 UTC m=+550.146410307"
Sep 11 12:36:01.751319 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:01.751285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:05.535336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:05.535295    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:06.473886 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:06.473854    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"
Sep 11 12:36:09.610796 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:09.610767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:09.700355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:09.700320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:10.080511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:10.080478    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:21.806126 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.806077    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:21.905712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.905680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:21.947710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.947669    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-r45vz"]
Sep 11 12:36:21.956281 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.956253    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:21.957019 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.956990    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-r45vz"]
Sep 11 12:36:21.998788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:21.998757    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-r45vz"]
Sep 11 12:36:21.999045 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:36:21.999007    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4wg4c], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-r45vz" podUID="18f74c99-8f03-46d6-81d7-2ba57230ea8e"
Sep 11 12:36:22.033138 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.033112    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-p5zmg"]
Sep 11 12:36:22.039223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.039203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.042099 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.042075    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 12:36:22.044151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.044131    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-p5zmg"]
Sep 11 12:36:22.048948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.048920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wg4c\" (UniqueName: \"kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c\") pod \"authorino-557f876f69-r45vz\" (UID: \"18f74c99-8f03-46d6-81d7-2ba57230ea8e\") " pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:22.149631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.149547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmtz\" (UniqueName: \"kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.149631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.149588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wg4c\" (UniqueName: \"kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c\") pod \"authorino-557f876f69-r45vz\" (UID: \"18f74c99-8f03-46d6-81d7-2ba57230ea8e\") " pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:22.149631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.149609    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.158247 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.158214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wg4c\" (UniqueName: \"kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c\") pod \"authorino-557f876f69-r45vz\" (UID: \"18f74c99-8f03-46d6-81d7-2ba57230ea8e\") " pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:22.197101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.197069    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-p5zmg"]
Sep 11 12:36:22.197314 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:36:22.197286    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2dmtz tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-p5zmg" podUID="19266498-18e0-44bd-9d76-179c251523ae"
Sep 11 12:36:22.223687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.223661    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:36:22.227754 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.227735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.235968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.235946    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:36:22.250899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.250870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmtz\" (UniqueName: \"kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.251009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.250915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.253318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.253298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.259748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.259725    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmtz\" (UniqueName: \"kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz\") pod \"authorino-6d4dfc649f-p5zmg\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") " pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.351962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.351931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.352129 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.351986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rrf\" (UniqueName: \"kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.452826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.452731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.452826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.452827    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rrf\" (UniqueName: \"kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.455164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.455140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.463548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.463522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rrf\" (UniqueName: \"kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf\") pod \"authorino-7f5fbd45d9-88h7d\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") " pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.538318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.538292    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:36:22.621462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.621434    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.621462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.621451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:22.628291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.628267    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:22.632064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.632007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:22.755874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.755851    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert\") pod \"19266498-18e0-44bd-9d76-179c251523ae\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") "
Sep 11 12:36:22.756009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.755902    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dmtz\" (UniqueName: \"kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz\") pod \"19266498-18e0-44bd-9d76-179c251523ae\" (UID: \"19266498-18e0-44bd-9d76-179c251523ae\") "
Sep 11 12:36:22.756009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.755947    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wg4c\" (UniqueName: \"kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c\") pod \"18f74c99-8f03-46d6-81d7-2ba57230ea8e\" (UID: \"18f74c99-8f03-46d6-81d7-2ba57230ea8e\") "
Sep 11 12:36:22.758042 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.758005    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "19266498-18e0-44bd-9d76-179c251523ae" (UID: "19266498-18e0-44bd-9d76-179c251523ae"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:36:22.758144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.758091    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c" (OuterVolumeSpecName: "kube-api-access-4wg4c") pod "18f74c99-8f03-46d6-81d7-2ba57230ea8e" (UID: "18f74c99-8f03-46d6-81d7-2ba57230ea8e"). InnerVolumeSpecName "kube-api-access-4wg4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:36:22.758144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.758103    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz" (OuterVolumeSpecName: "kube-api-access-2dmtz") pod "19266498-18e0-44bd-9d76-179c251523ae" (UID: "19266498-18e0-44bd-9d76-179c251523ae"). InnerVolumeSpecName "kube-api-access-2dmtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:36:22.824651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.824627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:36:22.826077 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:36:22.826051    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7691fe7a_e8b2_4cb1_b997_2b6aaa100013.slice/crio-630f25cd132f5e896a7f0d463610a25a320abccf22941adc586bba2be1a090a3 WatchSource:0}: Error finding container 630f25cd132f5e896a7f0d463610a25a320abccf22941adc586bba2be1a090a3: Status 404 returned error can't find the container with id 630f25cd132f5e896a7f0d463610a25a320abccf22941adc586bba2be1a090a3
Sep 11 12:36:22.857285 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.857259    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wg4c\" (UniqueName: \"kubernetes.io/projected/18f74c99-8f03-46d6-81d7-2ba57230ea8e-kube-api-access-4wg4c\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:36:22.857285 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.857281    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19266498-18e0-44bd-9d76-179c251523ae-tls-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:36:22.857414 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:22.857297    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dmtz\" (UniqueName: \"kubernetes.io/projected/19266498-18e0-44bd-9d76-179c251523ae-kube-api-access-2dmtz\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:36:23.628738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.628691    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" event={"ID":"7691fe7a-e8b2-4cb1-b997-2b6aaa100013","Type":"ContainerStarted","Data":"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"}
Sep 11 12:36:23.628738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.628742    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" event={"ID":"7691fe7a-e8b2-4cb1-b997-2b6aaa100013","Type":"ContainerStarted","Data":"630f25cd132f5e896a7f0d463610a25a320abccf22941adc586bba2be1a090a3"}
Sep 11 12:36:23.629006 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.628836    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-p5zmg"
Sep 11 12:36:23.629006 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.628912    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-r45vz"
Sep 11 12:36:23.646188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.646148    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" podStartSLOduration=1.150667547 podStartE2EDuration="1.64613351s" totalImagesPullingTime="495.465963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:36:23.645108593 +0000 UTC m=+576.289001254" watchObservedRunningTime="2026-09-11 12:36:23.64613351 +0000 UTC m=+576.290026168"
Sep 11 12:36:23.670637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.670609    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-r45vz"]
Sep 11 12:36:23.682902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.682869    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-r45vz"]
Sep 11 12:36:23.684937 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.684915    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:36:23.685110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.685089    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-chpj9" podUID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" containerName="authorino" containerID="cri-o://f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1" gracePeriod=30
Sep 11 12:36:23.705520 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.705484    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-p5zmg"]
Sep 11 12:36:23.709153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.709129    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-p5zmg"]
Sep 11 12:36:23.880554 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.880489    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f74c99-8f03-46d6-81d7-2ba57230ea8e" path="/var/lib/kubelet/pods/18f74c99-8f03-46d6-81d7-2ba57230ea8e/volumes"
Sep 11 12:36:23.880861 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.880731    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19266498-18e0-44bd-9d76-179c251523ae" path="/var/lib/kubelet/pods/19266498-18e0-44bd-9d76-179c251523ae/volumes"
Sep 11 12:36:23.925559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:23.925537    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:36:24.069561 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.069532    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnpsp\" (UniqueName: \"kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp\") pod \"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0\" (UID: \"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0\") "
Sep 11 12:36:24.071535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.071501    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp" (OuterVolumeSpecName: "kube-api-access-xnpsp") pod "f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" (UID: "f2640e2d-e6fc-40aa-a1f8-766d674ac0a0"). InnerVolumeSpecName "kube-api-access-xnpsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:36:24.170549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.170522    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnpsp\" (UniqueName: \"kubernetes.io/projected/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0-kube-api-access-xnpsp\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:36:24.635739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.635703    2584 generic.go:356] "Generic (PLEG): container finished" podID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" containerID="f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1" exitCode=0
Sep 11 12:36:24.635911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.635744    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-chpj9"
Sep 11 12:36:24.635911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.635785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-chpj9" event={"ID":"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0","Type":"ContainerDied","Data":"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"}
Sep 11 12:36:24.635911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.635826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-chpj9" event={"ID":"f2640e2d-e6fc-40aa-a1f8-766d674ac0a0","Type":"ContainerDied","Data":"24cf2f0345217581c0c8712cb9131da3fa9f1bd7dd44b514708a5ebd7fb7236f"}
Sep 11 12:36:24.635911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.635844    2584 scope.go:117] "RemoveContainer" containerID="f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"
Sep 11 12:36:24.644762 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.644744    2584 scope.go:117] "RemoveContainer" containerID="f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"
Sep 11 12:36:24.645019 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:36:24.645001    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1\": container with ID starting with f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1 not found: ID does not exist" containerID="f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"
Sep 11 12:36:24.645103 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.645050    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1"} err="failed to get container status \"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1\": rpc error: code = NotFound desc = could not find container \"f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1\": container with ID starting with f79e919e9ce8a96e45f1d6be163d0d7b2e772aaa2c503eaa3d27efba411fd1f1 not found: ID does not exist"
Sep 11 12:36:24.657433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.657406    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:36:24.661403 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:24.661384    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-chpj9"]
Sep 11 12:36:25.876779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:25.876748    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" path="/var/lib/kubelet/pods/f2640e2d-e6fc-40aa-a1f8-766d674ac0a0/volumes"
Sep 11 12:36:28.487657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:28.487626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:28.587300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:28.587261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:28.685174 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:28.685137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:28.787059 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:28.786937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:28.886367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:28.886333    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:32.046583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:32.046544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:32.151384 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:32.151352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:36:48.045052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:36:48.044996    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:04.759237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:04.759197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:06.334404 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:06.334366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:06.608619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:06.608511    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:06.705356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:06.705322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:06.900169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:06.900066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:07.002360 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:07.002322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:07.192057 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:07.191966    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:37:16.674699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.674604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:16.766747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.766717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:16.914796 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.914769    2584 generic.go:356] "Generic (PLEG): container finished" podID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerID="69e154b674afa5368d6e45cf943cc0ca0ecd14a78db9a5ba28b84d3660afbe6f" exitCode=0
Sep 11 12:37:16.914927 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.914812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" event={"ID":"509ded33-17ab-44f0-b1b4-b79229f85a18","Type":"ContainerDied","Data":"69e154b674afa5368d6e45cf943cc0ca0ecd14a78db9a5ba28b84d3660afbe6f"}
Sep 11 12:37:16.915131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.915112    2584 scope.go:117] "RemoveContainer" containerID="69e154b674afa5368d6e45cf943cc0ca0ecd14a78db9a5ba28b84d3660afbe6f"
Sep 11 12:37:16.916065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.916012    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:37:16.916157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.916121    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:37:16.916220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:16.916171    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:37:17.922152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:17.922113    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" event={"ID":"509ded33-17ab-44f0-b1b4-b79229f85a18","Type":"ContainerStarted","Data":"287049c72df4901c4595e4fc87a1033b10c4c53d9535b0cbd1b81f324170b138"}
Sep 11 12:37:18.080714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:18.080676    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:37:18.080968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:18.080944    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:18.081041 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:18.081007    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:19.081627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:19.081593    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:19.082111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:19.081661    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:20.081258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:20.081222    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:20.081452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:20.081277    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:21.081461 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:21.081419    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:21.082011 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:21.081487    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:22.081023 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:22.080986    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:22.081225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:22.081062    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:23.081191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:23.081154    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8pcrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 11 12:37:23.081576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:23.081214    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm" podUID="509ded33-17ab-44f0-b1b4-b79229f85a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 11 12:37:23.448956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:23.448883    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:37:23.887079 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:23.887024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:23.940290 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:23.940254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:24.084946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:24.084924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:37:24.085863 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:24.085844    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8pcrm"
Sep 11 12:37:29.823305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:29.823261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:30.378768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:30.378733    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:37:30.909750 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:30.909716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:43.009730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:43.009691    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:43.774359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:43.774320    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:37:49.610899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:49.610859    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:37:50.578651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:37:50.578620    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:38:02.431873 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:02.431817    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:38:03.680570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:03.680525    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:38:10.108976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:10.108929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:38:11.678181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:11.678137    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:38:27.022870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:27.022835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:38:28.707536 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:28.707496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:38:39.313788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:39.313738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:38:41.695615 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:38:41.695519    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:39:44.140483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.140444    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-685c8d4ddd-wqnr2"]
Sep 11 12:39:44.140963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.140879    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" containerName="authorino"
Sep 11 12:39:44.140963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.140900    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" containerName="authorino"
Sep 11 12:39:44.141076 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.140971    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2640e2d-e6fc-40aa-a1f8-766d674ac0a0" containerName="authorino"
Sep 11 12:39:44.142899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.142882    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.152488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.152463    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685c8d4ddd-wqnr2"]
Sep 11 12:39:44.214866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.214830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2f5de07-eed1-419a-bfb6-98d9c430361b-tls-cert\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.215005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.214874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkz8\" (UniqueName: \"kubernetes.io/projected/f2f5de07-eed1-419a-bfb6-98d9c430361b-kube-api-access-6jkz8\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.315782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.315754    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2f5de07-eed1-419a-bfb6-98d9c430361b-tls-cert\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.315906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.315790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkz8\" (UniqueName: \"kubernetes.io/projected/f2f5de07-eed1-419a-bfb6-98d9c430361b-kube-api-access-6jkz8\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.318275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.318252    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2f5de07-eed1-419a-bfb6-98d9c430361b-tls-cert\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.324724 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.324700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkz8\" (UniqueName: \"kubernetes.io/projected/f2f5de07-eed1-419a-bfb6-98d9c430361b-kube-api-access-6jkz8\") pod \"authorino-685c8d4ddd-wqnr2\" (UID: \"f2f5de07-eed1-419a-bfb6-98d9c430361b\") " pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.452467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.452410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685c8d4ddd-wqnr2"
Sep 11 12:39:44.727085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.727062    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685c8d4ddd-wqnr2"]
Sep 11 12:39:44.728914 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:39:44.728885    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2f5de07_eed1_419a_bfb6_98d9c430361b.slice/crio-16b2bdc8cea4e4150168904c18ab179e5fc69e7a61272c5d10ce60b22a6cd34d WatchSource:0}: Error finding container 16b2bdc8cea4e4150168904c18ab179e5fc69e7a61272c5d10ce60b22a6cd34d: Status 404 returned error can't find the container with id 16b2bdc8cea4e4150168904c18ab179e5fc69e7a61272c5d10ce60b22a6cd34d
Sep 11 12:39:44.730718 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.730697    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:39:44.737488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:44.737460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685c8d4ddd-wqnr2" event={"ID":"f2f5de07-eed1-419a-bfb6-98d9c430361b","Type":"ContainerStarted","Data":"16b2bdc8cea4e4150168904c18ab179e5fc69e7a61272c5d10ce60b22a6cd34d"}
Sep 11 12:39:45.745178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:45.745145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685c8d4ddd-wqnr2" event={"ID":"f2f5de07-eed1-419a-bfb6-98d9c430361b","Type":"ContainerStarted","Data":"7eb1d95f25ca09015cc35fa28ccb30e488433eada3237ba4de51fba08ea4acbc"}
Sep 11 12:39:45.764064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:45.764006    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-685c8d4ddd-wqnr2" podStartSLOduration=0.843835195 podStartE2EDuration="1.763989907s" totalImagesPullingTime="920.154712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:39:45.762387838 +0000 UTC m=+778.406280496" watchObservedRunningTime="2026-09-11 12:39:45.763989907 +0000 UTC m=+778.407882559"
Sep 11 12:39:45.793807 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:45.793773    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:39:45.794236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:45.794204    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" podUID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" containerName="authorino" containerID="cri-o://34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5" gracePeriod=30
Sep 11 12:39:46.037844 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.037815    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:39:46.130957 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.130919    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert\") pod \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") "
Sep 11 12:39:46.131144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.131059    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8rrf\" (UniqueName: \"kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf\") pod \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\" (UID: \"7691fe7a-e8b2-4cb1-b997-2b6aaa100013\") "
Sep 11 12:39:46.133050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.133005    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf" (OuterVolumeSpecName: "kube-api-access-q8rrf") pod "7691fe7a-e8b2-4cb1-b997-2b6aaa100013" (UID: "7691fe7a-e8b2-4cb1-b997-2b6aaa100013"). InnerVolumeSpecName "kube-api-access-q8rrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:39:46.141166 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.141141    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7691fe7a-e8b2-4cb1-b997-2b6aaa100013" (UID: "7691fe7a-e8b2-4cb1-b997-2b6aaa100013"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:39:46.231998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.231916    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-tls-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:39:46.231998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.231950    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8rrf\" (UniqueName: \"kubernetes.io/projected/7691fe7a-e8b2-4cb1-b997-2b6aaa100013-kube-api-access-q8rrf\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:39:46.294504 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.294464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:39:46.386917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.386875    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:39:46.759237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.759196    2584 generic.go:356] "Generic (PLEG): container finished" podID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" containerID="34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5" exitCode=0
Sep 11 12:39:46.759721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.759249    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d"
Sep 11 12:39:46.759721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.759275    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" event={"ID":"7691fe7a-e8b2-4cb1-b997-2b6aaa100013","Type":"ContainerDied","Data":"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"}
Sep 11 12:39:46.759721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.759326    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5fbd45d9-88h7d" event={"ID":"7691fe7a-e8b2-4cb1-b997-2b6aaa100013","Type":"ContainerDied","Data":"630f25cd132f5e896a7f0d463610a25a320abccf22941adc586bba2be1a090a3"}
Sep 11 12:39:46.759721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.759351    2584 scope.go:117] "RemoveContainer" containerID="34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"
Sep 11 12:39:46.771121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.771098    2584 scope.go:117] "RemoveContainer" containerID="34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"
Sep 11 12:39:46.771595 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:39:46.771568    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5\": container with ID starting with 34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5 not found: ID does not exist" containerID="34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"
Sep 11 12:39:46.771681 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.771611    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5"} err="failed to get container status \"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5\": rpc error: code = NotFound desc = could not find container \"34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5\": container with ID starting with 34be6eabe2a01212c5447284baa639d3eb6921456972000aaff5156086585ab5 not found: ID does not exist"
Sep 11 12:39:46.787176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.787152    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:39:46.791076 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:46.791053    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f5fbd45d9-88h7d"]
Sep 11 12:39:47.392949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:47.392914    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:39:47.488988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:47.488948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:39:47.879392 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:47.879363    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" path="/var/lib/kubelet/pods/7691fe7a-e8b2-4cb1-b997-2b6aaa100013/volumes"
Sep 11 12:39:48.632225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:39:48.632181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:03.122001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.121969    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:03.234168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.234130    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:03.496692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.496662    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:40:03.497060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.497017    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" containerName="authorino"
Sep 11 12:40:03.497189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.497068    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" containerName="authorino"
Sep 11 12:40:03.497189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.497167    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7691fe7a-e8b2-4cb1-b997-2b6aaa100013" containerName="authorino"
Sep 11 12:40:03.499758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.499735    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.502723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.502697    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-edce0b-openshift-default-dockercfg-sr8l8\""
Sep 11 12:40:03.525382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.525353    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:40:03.533210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.533181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:03.577412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577385    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577742 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577742 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577742 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577742 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577729    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzbts\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.577910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.577772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.678923 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.678890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.678944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.678966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.678983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzbts\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679007    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679713    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.679872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.679851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.681637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.681617    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.681748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.681639    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.716168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.716144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.721787 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.721756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzbts\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts\") pod \"e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") " pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:03.779180 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.779095    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:03.810483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:03.810463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:04.117485 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.117458    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:40:04.118368 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:04.118344    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ec7e51_f2ff_4df0_8f6a_f6d33a2f0ae4.slice/crio-b069bc61c9c37fa8007a39f77d3ca19524de6311bb59c3a1faf51067180902f1 WatchSource:0}: Error finding container b069bc61c9c37fa8007a39f77d3ca19524de6311bb59c3a1faf51067180902f1: Status 404 returned error can't find the container with id b069bc61c9c37fa8007a39f77d3ca19524de6311bb59c3a1faf51067180902f1
Sep 11 12:40:04.120422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.120392    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:04.120534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.120471    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:04.120534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.120518    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:04.576884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.576844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:04.694714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.694686    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:04.865237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.865159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerStarted","Data":"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"}
Sep 11 12:40:04.865237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.865208    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerStarted","Data":"b069bc61c9c37fa8007a39f77d3ca19524de6311bb59c3a1faf51067180902f1"}
Sep 11 12:40:04.890911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:04.890870    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podStartSLOduration=1.890856233 podStartE2EDuration="1.890856233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:04.888445015 +0000 UTC m=+797.532337673" watchObservedRunningTime="2026-09-11 12:40:04.890856233 +0000 UTC m=+797.534748890"
Sep 11 12:40:05.009526 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.009498    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:05.153730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.153659    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7654-53cf3c"]
Sep 11 12:40:05.156155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.156138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:05.159405 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.159385    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f4fwg\""
Sep 11 12:40:05.166309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.166288    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7654-53cf3c"]
Sep 11 12:40:05.293936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.293905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9l7k\" (UniqueName: \"kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k\") pod \"test-curl-7654-53cf3c\" (UID: \"3be3f21e-079b-4d98-b8f7-472130c9b3f2\") " pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:05.394741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.394713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9l7k\" (UniqueName: \"kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k\") pod \"test-curl-7654-53cf3c\" (UID: \"3be3f21e-079b-4d98-b8f7-472130c9b3f2\") " pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:05.404668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.404615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9l7k\" (UniqueName: \"kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k\") pod \"test-curl-7654-53cf3c\" (UID: \"3be3f21e-079b-4d98-b8f7-472130c9b3f2\") " pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:05.466639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.466610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:05.741111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.740959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7654-53cf3c"]
Sep 11 12:40:05.810748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.810718    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:05.815659 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.815638    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:05.877097 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.877061    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7654-53cf3c" event={"ID":"3be3f21e-079b-4d98-b8f7-472130c9b3f2","Type":"ContainerStarted","Data":"d41fa9e1e4ee4a11a89b17672b1bb522f21b57539ffce3bdae411098445b7c47"}
Sep 11 12:40:05.877210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.877101    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:05.877210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:05.877166    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:06.830658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:06.830554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:06.936658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:06.936613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:07.290265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:07.290230    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:40:07.990016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:07.989974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:08.086948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.086905    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:08.175719 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.175683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:08.607655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.607557    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:08.709748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.709715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:08.899317 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.899222    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7654-53cf3c" event={"ID":"3be3f21e-079b-4d98-b8f7-472130c9b3f2","Type":"ContainerStarted","Data":"d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280"}
Sep 11 12:40:08.914279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:08.914230    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7654-53cf3c" podStartSLOduration=1.450669024 podStartE2EDuration="3.91421681s" totalImagesPullingTime="2.463547786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:08.913264384 +0000 UTC m=+801.557157041" watchObservedRunningTime="2026-09-11 12:40:08.91421681 +0000 UTC m=+801.558109467"
Sep 11 12:40:09.491083 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.491050    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7654-53cf3c"]
Sep 11 12:40:09.498871 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.498842    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7654-53cf3c"]
Sep 11 12:40:09.612617 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.612535    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7654-f47de3"]
Sep 11 12:40:09.612990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.612971    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" containerName="test-curl-7654-53cf3c"
Sep 11 12:40:09.613121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.612992    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" containerName="test-curl-7654-53cf3c"
Sep 11 12:40:09.613178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.613126    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" containerName="test-curl-7654-53cf3c"
Sep 11 12:40:09.616388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.616366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:09.620906 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.620882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7654-f47de3"]
Sep 11 12:40:09.734961 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.734923    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db5zs\" (UniqueName: \"kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs\") pod \"test-curl-7654-f47de3\" (UID: \"b514375f-f796-40e5-9d62-91295a9dd00f\") " pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:09.835382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.835350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db5zs\" (UniqueName: \"kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs\") pod \"test-curl-7654-f47de3\" (UID: \"b514375f-f796-40e5-9d62-91295a9dd00f\") " pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:09.844227 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.844201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db5zs\" (UniqueName: \"kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs\") pod \"test-curl-7654-f47de3\" (UID: \"b514375f-f796-40e5-9d62-91295a9dd00f\") " pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:09.904591 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:40:09.904535    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7654-53cf3c" container="test-curl-7654-53cf3c"
Sep 11 12:40:09.927917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:09.927895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:10.196821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.196791    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7654-f47de3"]
Sep 11 12:40:10.198610 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:10.198585    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb514375f_f796_40e5_9d62_91295a9dd00f.slice/crio-1d7bca25fb02f5def900a4642492be1b928c0f3dfafa449db1939ed94515e828 WatchSource:0}: Error finding container 1d7bca25fb02f5def900a4642492be1b928c0f3dfafa449db1939ed94515e828: Status 404 returned error can't find the container with id 1d7bca25fb02f5def900a4642492be1b928c0f3dfafa449db1939ed94515e828
Sep 11 12:40:10.856344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.856313    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:10.912194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.912154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7654-f47de3" event={"ID":"b514375f-f796-40e5-9d62-91295a9dd00f","Type":"ContainerStarted","Data":"469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170"}
Sep 11 12:40:10.912194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.912195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7654-f47de3" event={"ID":"b514375f-f796-40e5-9d62-91295a9dd00f","Type":"ContainerStarted","Data":"1d7bca25fb02f5def900a4642492be1b928c0f3dfafa449db1939ed94515e828"}
Sep 11 12:40:10.912398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.912232    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7654-53cf3c" podUID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" containerName="test-curl-7654-53cf3c" containerID="cri-o://d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280" gracePeriod=2
Sep 11 12:40:10.933819 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.933777    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7654-f47de3" podStartSLOduration=1.93376349 podStartE2EDuration="1.93376349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:10.933542178 +0000 UTC m=+803.577434837" watchObservedRunningTime="2026-09-11 12:40:10.93376349 +0000 UTC m=+803.577656147"
Sep 11 12:40:10.940417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:10.940390    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:11.161757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.161679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:11.415781 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.415703    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:40:11.419656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.419633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.422575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.422288    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0d7de9d8-openshift-default-dockercfg-n5zgf\""
Sep 11 12:40:11.433787 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.433765    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:40:11.466297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.466270    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:11.548923 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.548888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:11.550982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.550961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.550992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksnt\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551139    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.551310 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.551260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.600505 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.600474    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7654-f47de3"]
Sep 11 12:40:11.606772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.606747    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7654-f47de3"]
Sep 11 12:40:11.651677 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksnt\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.651942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.651901    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.652163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.652137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.652163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.652154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.652286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.652245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.652438 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.652414    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.652749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.652726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.654064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.654047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.654296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.654278    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.660839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.660817    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.661105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.661087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksnt\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt\") pod \"e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") " pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.732221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:11.732197    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:11.917802 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:40:11.917773    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7654-f47de3" container="test-curl-7654-f47de3"
Sep 11 12:40:12.017473 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.017448    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:40:12.018425 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:12.018398    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dafb6e_316b_4613_a470_fab2480f754f.slice/crio-9e6aaebf8251feb725e506b6b76b685024f6ed26e2c741b28ceabca6c8c52dd2 WatchSource:0}: Error finding container 9e6aaebf8251feb725e506b6b76b685024f6ed26e2c741b28ceabca6c8c52dd2: Status 404 returned error can't find the container with id 9e6aaebf8251feb725e506b6b76b685024f6ed26e2c741b28ceabca6c8c52dd2
Sep 11 12:40:12.023573 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.023535    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:12.023690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.023615    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:12.023690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.023659    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:12.109444 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.109411    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:12.388315 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.388235    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:40:12.388689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.388670    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b514375f-f796-40e5-9d62-91295a9dd00f" containerName="test-curl-7654-f47de3"
Sep 11 12:40:12.388689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.388689    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b514375f-f796-40e5-9d62-91295a9dd00f" containerName="test-curl-7654-f47de3"
Sep 11 12:40:12.388779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.388758    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b514375f-f796-40e5-9d62-91295a9dd00f" containerName="test-curl-7654-f47de3"
Sep 11 12:40:12.392107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.392084    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.396133 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.396112    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-9878a9-openshift-default-dockercfg-9pkfd\""
Sep 11 12:40:12.414517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.414495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:40:12.459411 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459379    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459442    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7dg\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.459717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.459695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.461363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.461316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:12.560701 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7dg\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560701 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560832    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.560954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560924    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.560973    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.561234    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.561357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.561419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561528 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.561507    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.561832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.561812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.563213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.563193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.563361 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.563342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.572378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.572356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.580260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.580240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7dg\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg\") pod \"e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") " pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.704389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.704322    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:12.735969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.735936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:12.926855 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.926823    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerStarted","Data":"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"}
Sep 11 12:40:12.927181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.926888    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerStarted","Data":"9e6aaebf8251feb725e506b6b76b685024f6ed26e2c741b28ceabca6c8c52dd2"}
Sep 11 12:40:12.927181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.927014    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7654-f47de3" podUID="b514375f-f796-40e5-9d62-91295a9dd00f" containerName="test-curl-7654-f47de3" containerID="cri-o://469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170" gracePeriod=2
Sep 11 12:40:12.990503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.989855    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podStartSLOduration=1.989829871 podStartE2EDuration="1.989829871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:12.956167909 +0000 UTC m=+805.600060568" watchObservedRunningTime="2026-09-11 12:40:12.989829871 +0000 UTC m=+805.633722528"
Sep 11 12:40:12.992262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.992201    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:40:12.992433 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:12.992413    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a39193_d29a_4af7_9532_0bc0d0494249.slice/crio-bd7c63c59d5949f12c0a2040c3604861e1b0c29f92736937187c701312862ca3 WatchSource:0}: Error finding container bd7c63c59d5949f12c0a2040c3604861e1b0c29f92736937187c701312862ca3: Status 404 returned error can't find the container with id bd7c63c59d5949f12c0a2040c3604861e1b0c29f92736937187c701312862ca3
Sep 11 12:40:12.994790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.994754    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:12.994895 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.994812    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:12.994895 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:12.994838    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:13.101218 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.101191    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:13.267566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.267535    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9l7k\" (UniqueName: \"kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k\") pod \"3be3f21e-079b-4d98-b8f7-472130c9b3f2\" (UID: \"3be3f21e-079b-4d98-b8f7-472130c9b3f2\") "
Sep 11 12:40:13.269737 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.269704    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k" (OuterVolumeSpecName: "kube-api-access-b9l7k") pod "3be3f21e-079b-4d98-b8f7-472130c9b3f2" (UID: "3be3f21e-079b-4d98-b8f7-472130c9b3f2"). InnerVolumeSpecName "kube-api-access-b9l7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:40:13.369135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.369104    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9l7k\" (UniqueName: \"kubernetes.io/projected/3be3f21e-079b-4d98-b8f7-472130c9b3f2-kube-api-access-b9l7k\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:40:13.732628 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.732591    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:13.737226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.737203    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:13.877000 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.876968    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" path="/var/lib/kubelet/pods/3be3f21e-079b-4d98-b8f7-472130c9b3f2/volumes"
Sep 11 12:40:13.934001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.933934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerStarted","Data":"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"}
Sep 11 12:40:13.934001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.933984    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerStarted","Data":"bd7c63c59d5949f12c0a2040c3604861e1b0c29f92736937187c701312862ca3"}
Sep 11 12:40:13.935210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.935187    2584 generic.go:356] "Generic (PLEG): container finished" podID="3be3f21e-079b-4d98-b8f7-472130c9b3f2" containerID="d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280" exitCode=137
Sep 11 12:40:13.935300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.935221    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-53cf3c"
Sep 11 12:40:13.935300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.935276    2584 scope.go:117] "RemoveContainer" containerID="d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280"
Sep 11 12:40:13.935443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.935429    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:13.936375 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.936354    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:13.943891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.943873    2584 scope.go:117] "RemoveContainer" containerID="d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280"
Sep 11 12:40:13.944150 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:40:13.944133    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280\": container with ID starting with d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280 not found: ID does not exist" containerID="d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280"
Sep 11 12:40:13.944208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.944158    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280"} err="failed to get container status \"d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280\": rpc error: code = NotFound desc = could not find container \"d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280\": container with ID starting with d6120e223a293b30486efad7c56d69a57c36a8e8af3a96c3818faf9315c8d280 not found: ID does not exist"
Sep 11 12:40:13.964072 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:13.964017    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podStartSLOduration=1.964005783 podStartE2EDuration="1.964005783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:13.962730396 +0000 UTC m=+806.606623067" watchObservedRunningTime="2026-09-11 12:40:13.964005783 +0000 UTC m=+806.607898441"
Sep 11 12:40:14.366234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.366177    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:14.469211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.469174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:14.705225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.705144    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:14.710679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.710651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:14.943652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.943594    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:14.944979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:14.944958    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:15.095544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.095518    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:15.188808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.188776    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db5zs\" (UniqueName: \"kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs\") pod \"b514375f-f796-40e5-9d62-91295a9dd00f\" (UID: \"b514375f-f796-40e5-9d62-91295a9dd00f\") "
Sep 11 12:40:15.190816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.190792    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs" (OuterVolumeSpecName: "kube-api-access-db5zs") pod "b514375f-f796-40e5-9d62-91295a9dd00f" (UID: "b514375f-f796-40e5-9d62-91295a9dd00f"). InnerVolumeSpecName "kube-api-access-db5zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:40:15.289726 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.289645    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db5zs\" (UniqueName: \"kubernetes.io/projected/b514375f-f796-40e5-9d62-91295a9dd00f-kube-api-access-db5zs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:40:15.635157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.635074    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:15.737834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.737789    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:15.878429 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.878393    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b514375f-f796-40e5-9d62-91295a9dd00f" path="/var/lib/kubelet/pods/b514375f-f796-40e5-9d62-91295a9dd00f/volumes"
Sep 11 12:40:15.949834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.949789    2584 generic.go:356] "Generic (PLEG): container finished" podID="b514375f-f796-40e5-9d62-91295a9dd00f" containerID="469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170" exitCode=137
Sep 11 12:40:15.949834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.949837    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7654-f47de3"
Sep 11 12:40:15.950379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.949893    2584 scope.go:117] "RemoveContainer" containerID="469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170"
Sep 11 12:40:15.958970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.958958    2584 scope.go:117] "RemoveContainer" containerID="469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170"
Sep 11 12:40:15.959291 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:40:15.959272    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170\": container with ID starting with 469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170 not found: ID does not exist" containerID="469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170"
Sep 11 12:40:15.959340 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:15.959297    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170"} err="failed to get container status \"469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170\": rpc error: code = NotFound desc = could not find container \"469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170\": container with ID starting with 469fc5785192c175b594354fb7d8982dfe3debaef7885c882f9e1b7c398da170 not found: ID does not exist"
Sep 11 12:40:16.038420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:16.038384    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:16.189091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:16.188978    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:16.563420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:16.563382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:16.754966 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:16.754929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:17.650286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:17.650245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:18.053108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:18.053072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:18.216055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:18.215991    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:18.537827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:18.537796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:18.636353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:18.636321    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:18.957675 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:18.957583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:19.933994 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:19.933963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:22.602670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:22.602630    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:40:24.122340 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:24.122303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:24.282109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:24.282068    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:24.410767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:24.410662    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:24.503919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:24.503884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:27.204948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:27.204912    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:29.583047 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:29.582991    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:29.914790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:29.914694    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:30.737162 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:30.737126    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:30.846785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:30.846711    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:30.937256 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:30.937164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:31.146388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.146334    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:40:31.160624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.160578    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.162613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.162581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:40:31.163970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.163946    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 12:40:31.164117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.164076    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-67t6s\""
Sep 11 12:40:31.164191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.164124    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 12:40:31.165418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.165395    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-50eee0c3-kserve-self-signed-certs\""
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prlt\" (UniqueName: \"kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.233108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.232724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prlt\" (UniqueName: \"kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.334553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.335087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.335665    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.336621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.336224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.339412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.339189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.339412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.339377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.353772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.353734    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prlt\" (UniqueName: \"kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt\") pod \"e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") " pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.449051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.448655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:31.474533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.474488    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:31.783276 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.783141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:31.823542 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:31.823492    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:40:31.830015 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:31.829978    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3dd4806_a1b4_4baf_ad8d_0c326b2bbea5.slice/crio-61446fd2981c1e56e2087fb98ed543933df1d1b5365cf81d74cb937dd75b88d9 WatchSource:0}: Error finding container 61446fd2981c1e56e2087fb98ed543933df1d1b5365cf81d74cb937dd75b88d9: Status 404 returned error can't find the container with id 61446fd2981c1e56e2087fb98ed543933df1d1b5365cf81d74cb937dd75b88d9
Sep 11 12:40:32.074266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.074175    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" event={"ID":"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5","Type":"ContainerStarted","Data":"61446fd2981c1e56e2087fb98ed543933df1d1b5365cf81d74cb937dd75b88d9"}
Sep 11 12:40:32.103631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.103598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:32.389632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.387732    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:40:32.393566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.392847    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.396667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.396637    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f06aba-openshift-default-dockercfg-4ztrw\""
Sep 11 12:40:32.409941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.409908    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:40:32.453049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.452838    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htz45\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457456    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.459312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.457645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558532    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htz45\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.558833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.559207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.559314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.559245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.560044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.559475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.560044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.559502    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.560479 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.560433    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.561283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.561261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.561283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.561273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.568573 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.568543    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htz45\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.569115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.569094    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token\") pod \"e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") " pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:32.693491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.693377    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:32.709835 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:32.709805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:33.056397 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:33.056352    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:40:33.576277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:33.576234    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:33.576357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:33.576332    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:33.576398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:33.576377    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:34.100000 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.099955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerStarted","Data":"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"}
Sep 11 12:40:34.100506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.100046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerStarted","Data":"fc3757a099b02f2c12ab9b8d6e1be7ee87fce9aa90b7a63f1edc70b577b6bea3"}
Sep 11 12:40:34.101663 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.101633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" event={"ID":"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5","Type":"ContainerStarted","Data":"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"}
Sep 11 12:40:34.132654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.132578    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podStartSLOduration=2.132554523 podStartE2EDuration="2.132554523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:34.128531031 +0000 UTC m=+826.772423694" watchObservedRunningTime="2026-09-11 12:40:34.132554523 +0000 UTC m=+826.776447184"
Sep 11 12:40:34.154769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.154689    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" podStartSLOduration=1.343992921 podStartE2EDuration="3.154663537s" totalImagesPullingTime="1.810670616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:34.153986751 +0000 UTC m=+826.797879410" watchObservedRunningTime="2026-09-11 12:40:34.154663537 +0000 UTC m=+826.798556195"
Sep 11 12:40:34.710526 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.710480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:34.715588 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:34.715557    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:35.109943 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.109909    2584 generic.go:356] "Generic (PLEG): container finished" podID="00dafb6e-316b-4613-a470-fab2480f754f" containerID="e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5" exitCode=0
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.109985    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerDied","Data":"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"}
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.110495    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.110608    2584 scope.go:117] "RemoveContainer" containerID="e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.111405    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.111616    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:35.111708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.111681    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:35.112213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:35.111712    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:36.118163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.118128    2584 generic.go:356] "Generic (PLEG): container finished" podID="83a39193-d29a-4af7-9532-0bc0d0494249" containerID="f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165" exitCode=0
Sep 11 12:40:36.118709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.118194    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerDied","Data":"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"}
Sep 11 12:40:36.118709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.118663    2584 scope.go:117] "RemoveContainer" containerID="f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"
Sep 11 12:40:36.119975 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.119944    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:36.120092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.120014    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:36.120092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.120081    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:36.120792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.120731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerStarted","Data":"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"}
Sep 11 12:40:36.155636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.155483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:36.256316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.256283    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:36.732912 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.732869    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:36.733132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.733058    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:36.733132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:36.733118    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:37.134091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.134003    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerStarted","Data":"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"}
Sep 11 12:40:37.493235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.493198    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:37.583067 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.582934    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:37.690627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.690594    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:37.705203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.705132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:37.705203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.705181    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:37.705379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.705222    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:37.734232 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.734192    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:37.734417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:37.734267    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:38.383054 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.382116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:38.482065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.481967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:38.704747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.704615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:38.705246 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.705209    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:38.705441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.705421    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:38.733495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.733451    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:38.733740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.733559    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:38.853480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.853433    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:38.947815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:38.947729    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:39.056738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.056691    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:39.705113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.705080    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:39.705559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.705132    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:39.733294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.733257    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:39.733489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.733335    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:39.740792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:39.740753    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:40.431647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:40.431610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:40.705641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:40.705544    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:40.705641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:40.705607    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:40.733377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:40.733344    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:40.733641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:40.733603    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:41.126948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.126914    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:41.477111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.477078    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:41.478600 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.478571    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:41.495452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.495426    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:41.705141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.705061    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:41.705141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.705118    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:41.733144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.732673    2584 patch_prober.go:28] interesting pod/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:40:41.733144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.732750    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 11 12:40:41.827842 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:41.827795    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:42.182171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.182076    2584 generic.go:356] "Generic (PLEG): container finished" podID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerID="749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1" exitCode=0
Sep 11 12:40:42.182318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.182158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerDied","Data":"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"}
Sep 11 12:40:42.182625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.182603    2584 scope.go:117] "RemoveContainer" containerID="749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"
Sep 11 12:40:42.183717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.183684    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:42.183792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.183753    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:42.183792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.183788    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:42.194622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.194600    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:40:42.704755 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.704710    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 12:40:42.704968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.704766    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 12:40:42.736810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.736763    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:42.737297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.737245    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:42.738153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:42.738131    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:40:43.190071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.190024    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerStarted","Data":"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"}
Sep 11 12:40:43.709366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.709333    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:43.709643 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.709616    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:43.710372 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.710354    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:40:43.811213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.811178    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:43.811592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.811384    2584 patch_prober.go:28] interesting pod/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:40:43.811592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:43.811444    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 12:40:44.811472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.811434    2584 patch_prober.go:28] interesting pod/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:40:44.811872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.811502    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 12:40:44.885987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.885956    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"]
Sep 11 12:40:44.888363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.888348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:40:44.890982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.890960    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:40:44.891094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.890963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:40:44.897083 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.897058    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"]
Sep 11 12:40:44.994486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:44.994448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v\" (UID: \"29612f4d-fb9f-40c9-a07e-4a9227e7d77e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:40:45.009312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.009274    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:45.094991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.094916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v\" (UID: \"29612f4d-fb9f-40c9-a07e-4a9227e7d77e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:40:45.095522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.095504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v\" (UID: \"29612f4d-fb9f-40c9-a07e-4a9227e7d77e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:40:45.135780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.135709    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:45.201412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.201385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:40:45.243579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.243495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:45.497920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.497884    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"]
Sep 11 12:40:45.502774 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:40:45.502747    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29612f4d_fb9f_40c9_a07e_4a9227e7d77e.slice/crio-763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1 WatchSource:0}: Error finding container 763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1: Status 404 returned error can't find the container with id 763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1
Sep 11 12:40:45.811460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.811379    2584 patch_prober.go:28] interesting pod/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:40:45.811460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.811436    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 12:40:45.985106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:45.985066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:46.209733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:46.209638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v" event={"ID":"29612f4d-fb9f-40c9-a07e-4a9227e7d77e","Type":"ContainerStarted","Data":"763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1"}
Sep 11 12:40:46.811284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:46.811244    2584 patch_prober.go:28] interesting pod/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:40:46.811469 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:46.811307    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 12:40:47.810989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:47.810955    2584 patch_prober.go:28] interesting pod/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:40:47.811378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:47.811011    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 12:40:48.804904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:48.804869    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:40:48.815861 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:48.815829    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:48.816372 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:48.816354    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:48.817125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:48.817101    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:40:58.930627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:58.930576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:40:59.317657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.317624    2584 generic.go:356] "Generic (PLEG): container finished" podID="5a38af68-cd20-4dec-9842-7dfba4856397" containerID="c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669" exitCode=0
Sep 11 12:40:59.317821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.317671    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerDied","Data":"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"}
Sep 11 12:40:59.318070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.318020    2584 scope.go:117] "RemoveContainer" containerID="c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"
Sep 11 12:40:59.319090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.319060    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:59.319222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.319150    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:40:59.319222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:40:59.319199    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:00.326479 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:00.326446    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerStarted","Data":"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"}
Sep 11 12:41:00.710331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:00.710229    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:41:00.711429 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:00.711403    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:00.711567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:00.711461    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:00.981251 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:00.981150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:01.710624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:01.710576    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:01.711101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:01.710644    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:02.710277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:02.710239    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:02.710467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:02.710291    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:03.710861 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:03.710827    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:03.711275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:03.710880    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:04.710679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:04.710641    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:04.710852 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:04.710692    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:05.110969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:05.110937    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:41:05.711154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:05.711118    2584 patch_prober.go:28] interesting pod/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 12:41:05.711359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:05.711180    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 12:41:06.715235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:06.715202    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:41:06.716432 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:06.716407    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:41:07.389547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:07.389511    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v" event={"ID":"29612f4d-fb9f-40c9-a07e-4a9227e7d77e","Type":"ContainerStarted","Data":"876efb6c9d8c7cf35e4372b8703edaab21b2efb580529ec9f2ca544471724d46"}
Sep 11 12:41:07.406713 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:07.406619    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v" podStartSLOduration=1.764722144 podStartE2EDuration="23.406602637s" totalImagesPullingTime="21.641880493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:07.405673558 +0000 UTC m=+860.049566217" watchObservedRunningTime="2026-09-11 12:41:07.406602637 +0000 UTC m=+860.050495329"
Sep 11 12:41:08.396751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:08.396715    2584 generic.go:356] "Generic (PLEG): container finished" podID="29612f4d-fb9f-40c9-a07e-4a9227e7d77e" containerID="876efb6c9d8c7cf35e4372b8703edaab21b2efb580529ec9f2ca544471724d46" exitCode=0
Sep 11 12:41:08.397134 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:08.396805    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v" event={"ID":"29612f4d-fb9f-40c9-a07e-4a9227e7d77e","Type":"ContainerDied","Data":"876efb6c9d8c7cf35e4372b8703edaab21b2efb580529ec9f2ca544471724d46"}
Sep 11 12:41:09.543674 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:09.543650    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:41:09.640924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:09.640890    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca\") pod \"29612f4d-fb9f-40c9-a07e-4a9227e7d77e\" (UID: \"29612f4d-fb9f-40c9-a07e-4a9227e7d77e\") "
Sep 11 12:41:09.641292 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:09.641271    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29612f4d-fb9f-40c9-a07e-4a9227e7d77e" (UID: "29612f4d-fb9f-40c9-a07e-4a9227e7d77e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:09.742172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:09.742143    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29612f4d-fb9f-40c9-a07e-4a9227e7d77e-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:10.408346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:10.408319    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"
Sep 11 12:41:10.408522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:10.408363    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v" event={"ID":"29612f4d-fb9f-40c9-a07e-4a9227e7d77e","Type":"ContainerDied","Data":"763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1"}
Sep 11 12:41:10.408522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:10.408409    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="763602a36d9ff2ff445bb9cb0a33068069d20db48178340934c43e724ea1e2e1"
Sep 11 12:41:15.833062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:15.833010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:16.424104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.424050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:16.507603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.507565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:16.592590 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.592555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:16.645193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.645158    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"]
Sep 11 12:41:16.650288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.650265    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0d7de9d8-z5b4v"]
Sep 11 12:41:16.676953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.676881    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:16.788880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.788847    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:41:16.789091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.789070    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy" containerID="cri-o://6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9" gracePeriod=30
Sep 11 12:41:16.801344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:16.801317    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:17.245648 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.245613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:17.346308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.346268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:17.669283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.669192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:17.721735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.721703    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:17.722180 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.722164    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29612f4d-fb9f-40c9-a07e-4a9227e7d77e" containerName="revoke-keys"
Sep 11 12:41:17.722180 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.722181    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="29612f4d-fb9f-40c9-a07e-4a9227e7d77e" containerName="revoke-keys"
Sep 11 12:41:17.722280 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.722265    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="29612f4d-fb9f-40c9-a07e-4a9227e7d77e" containerName="revoke-keys"
Sep 11 12:41:17.725126 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.725106    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.727833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.727812    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-47131dfa-gw-openshift-default-dockercfg-8qkhc\""
Sep 11 12:41:17.738335 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.738314    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:17.751501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.751476    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:17.877253 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.877220    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29612f4d-fb9f-40c9-a07e-4a9227e7d77e" path="/var/lib/kubelet/pods/29612f4d-fb9f-40c9-a07e-4a9227e7d77e/volumes"
Sep 11 12:41:17.921398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921393    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9gw\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921793 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921655    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:17.921793 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:17.921694    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022802    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022832    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9gw\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022951    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.022989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.022977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023395 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023395 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023798    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023838    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.023881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.023878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.026064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.026022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.026179 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.026096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.032966 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.032933    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9gw\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.033277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.033257    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token\") pod \"e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") " pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.033691 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.033667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:18.037380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.037363    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:18.326249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.326220    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:18.328480 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:41:18.328449    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d856a31_d3b3_4baa_bf6e_bee60ef22d01.slice/crio-ed1b11ddf24158098167495d9c19a73304a14b0d76c46f7b5fd505c125eec7f1 WatchSource:0}: Error finding container ed1b11ddf24158098167495d9c19a73304a14b0d76c46f7b5fd505c125eec7f1: Status 404 returned error can't find the container with id ed1b11ddf24158098167495d9c19a73304a14b0d76c46f7b5fd505c125eec7f1
Sep 11 12:41:18.330854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.330812    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:18.330960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.330872    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:18.330960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.330900    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:18.470608 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.470564    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerStarted","Data":"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"}
Sep 11 12:41:18.470819 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.470666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerStarted","Data":"ed1b11ddf24158098167495d9c19a73304a14b0d76c46f7b5fd505c125eec7f1"}
Sep 11 12:41:18.492637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:18.492570    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podStartSLOduration=1.492553435 podStartE2EDuration="1.492553435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:18.490623909 +0000 UTC m=+871.134516588" watchObservedRunningTime="2026-09-11 12:41:18.492553435 +0000 UTC m=+871.136446093"
Sep 11 12:41:19.037993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:19.037963    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:19.039433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:19.039404    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:19.039555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:19.039455    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:19.927867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:19.927830    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.032511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.032471    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.042534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.042507    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:20.242417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.242375    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.345120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.345088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.442750 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.442717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.482954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.482922    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:20.483887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.483869    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:20.805770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.805738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:20.903002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:20.902964    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:22.045356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.045331    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:41:22.060738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060672    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.060738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.060738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060730    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.060944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060762    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.060944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060866    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.060944 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.061147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060959    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.061147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.060988    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fksnt\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.061147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061018    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo\") pod \"00dafb6e-316b-4613-a470-fab2480f754f\" (UID: \"00dafb6e-316b-4613-a470-fab2480f754f\") "
Sep 11 12:41:22.061147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061057    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data" (OuterVolumeSpecName: "istio-data") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:22.061343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061186    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:22.061343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061223    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:22.061343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061260    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:22.061343 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061277    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:22.061495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061431    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.061495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061455    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.061495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061470    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.061495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061483    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.061649 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.061495    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dafb6e-316b-4613-a470-fab2480f754f-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.063125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.063096    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:41:22.063125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.063116    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token" (OuterVolumeSpecName: "istio-token") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:22.063280 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.063137    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt" (OuterVolumeSpecName: "kube-api-access-fksnt") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "kube-api-access-fksnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:22.063280 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.063234    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00dafb6e-316b-4613-a470-fab2480f754f" (UID: "00dafb6e-316b-4613-a470-fab2480f754f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:22.162366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.162326    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fksnt\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-kube-api-access-fksnt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.162366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.162363    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dafb6e-316b-4613-a470-fab2480f754f-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.162366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.162376    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dafb6e-316b-4613-a470-fab2480f754f-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.162607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.162387    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dafb6e-316b-4613-a470-fab2480f754f-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:22.495823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.495790    2584 generic.go:356] "Generic (PLEG): container finished" podID="00dafb6e-316b-4613-a470-fab2480f754f" containerID="6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9" exitCode=0
Sep 11 12:41:22.496018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.495851    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"
Sep 11 12:41:22.496018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.495880    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerDied","Data":"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"}
Sep 11 12:41:22.496018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.495961    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx" event={"ID":"00dafb6e-316b-4613-a470-fab2480f754f","Type":"ContainerDied","Data":"9e6aaebf8251feb725e506b6b76b685024f6ed26e2c741b28ceabca6c8c52dd2"}
Sep 11 12:41:22.496018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.495985    2584 scope.go:117] "RemoveContainer" containerID="6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"
Sep 11 12:41:22.509049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.509000    2584 scope.go:117] "RemoveContainer" containerID="e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"
Sep 11 12:41:22.518834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.518810    2584 scope.go:117] "RemoveContainer" containerID="6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"
Sep 11 12:41:22.519131 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:41:22.519113    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9\": container with ID starting with 6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9 not found: ID does not exist" containerID="6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"
Sep 11 12:41:22.519192 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.519139    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9"} err="failed to get container status \"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9\": rpc error: code = NotFound desc = could not find container \"6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9\": container with ID starting with 6a0932726bc5a89cbb02bfb3b1647aa390abae076a422a0aad0c329612fe22a9 not found: ID does not exist"
Sep 11 12:41:22.519192 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.519155    2584 scope.go:117] "RemoveContainer" containerID="e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"
Sep 11 12:41:22.519435 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:41:22.519416    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5\": container with ID starting with e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5 not found: ID does not exist" containerID="e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"
Sep 11 12:41:22.519484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.519441    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5"} err="failed to get container status \"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5\": rpc error: code = NotFound desc = could not find container \"e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5\": container with ID starting with e0600bf70c5d70decaa18efe76b1c54535d68359ed7548d08d6e7e8744dc43e5 not found: ID does not exist"
Sep 11 12:41:22.519926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.519908    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:41:22.525897 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:22.525870    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0d7de9d8-openshift-default-6568ddf878-hbrpx"]
Sep 11 12:41:23.877660 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:23.877619    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00dafb6e-316b-4613-a470-fab2480f754f" path="/var/lib/kubelet/pods/00dafb6e-316b-4613-a470-fab2480f754f/volumes"
Sep 11 12:41:25.377958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:25.377914    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:41:35.759988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:35.759957    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:39592->10.133.0.61:15021: read: connection reset by peer" start-of-body=
Sep 11 12:41:35.760375 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:35.760022    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": read tcp 10.133.0.2:39592->10.133.0.61:15021: read: connection reset by peer"
Sep 11 12:41:36.595211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.595178    2584 generic.go:356] "Generic (PLEG): container finished" podID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerID="2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f" exitCode=0
Sep 11 12:41:36.595211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.595213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerDied","Data":"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"}
Sep 11 12:41:36.595575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.595563    2584 scope.go:117] "RemoveContainer" containerID="2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"
Sep 11 12:41:36.596513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.596485    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:36.596622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.596550    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:36.596622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:36.596580    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:37.602118 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:37.602083    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerStarted","Data":"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"}
Sep 11 12:41:38.038046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:38.037989    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:38.038249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:38.038135    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:38.038249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:38.038182    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:39.037908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:39.037872    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:39.038488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:39.038455    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:40.037834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:40.037742    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:40.038103 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:40.038069    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:41.038593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:41.038546    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:41.039092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:41.038617    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:42.038189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:42.038143    2584 patch_prober.go:28] interesting pod/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 11 12:41:42.038400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:42.038227    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 11 12:41:43.042556 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:43.042524    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:43.042949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:43.042792    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:43.043420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:43.043399    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:44.852709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.852665    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"]
Sep 11 12:41:44.853105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.853044    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:44.853105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.853058    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:44.853185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.853131    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:44.855700 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.855683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:44.858460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.858436    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:41:44.858594 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.858442    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:41:44.864598 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:44.864558    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"]
Sep 11 12:41:45.004456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.004419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h\" (UID: \"1371a9bd-db3a-420a-89ac-8aad18ba65fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:45.105310 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.105232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h\" (UID: \"1371a9bd-db3a-420a-89ac-8aad18ba65fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:45.105803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.105784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h\" (UID: \"1371a9bd-db3a-420a-89ac-8aad18ba65fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:45.168769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.168739    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:45.438373 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.438350    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"]
Sep 11 12:41:45.440300 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:41:45.440271    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1371a9bd_db3a_420a_89ac_8aad18ba65fd.slice/crio-e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a WatchSource:0}: Error finding container e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a: Status 404 returned error can't find the container with id e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a
Sep 11 12:41:45.650929 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:45.650899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h" event={"ID":"1371a9bd-db3a-420a-89ac-8aad18ba65fd","Type":"ContainerStarted","Data":"e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a"}
Sep 11 12:41:46.658567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:46.658535    2584 generic.go:356] "Generic (PLEG): container finished" podID="1371a9bd-db3a-420a-89ac-8aad18ba65fd" containerID="ebc3a086e22b552f670a3e902dbb9cd6d77bfb4ce629866bde0d402115001870" exitCode=0
Sep 11 12:41:46.658942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:46.658579    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h" event={"ID":"1371a9bd-db3a-420a-89ac-8aad18ba65fd","Type":"ContainerDied","Data":"ebc3a086e22b552f670a3e902dbb9cd6d77bfb4ce629866bde0d402115001870"}
Sep 11 12:41:46.696979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:46.696945    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:41:47.819562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:47.819535    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:47.932889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:47.932865    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca\") pod \"1371a9bd-db3a-420a-89ac-8aad18ba65fd\" (UID: \"1371a9bd-db3a-420a-89ac-8aad18ba65fd\") "
Sep 11 12:41:47.933293 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:47.933265    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1371a9bd-db3a-420a-89ac-8aad18ba65fd" (UID: "1371a9bd-db3a-420a-89ac-8aad18ba65fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:48.034172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:48.034093    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1371a9bd-db3a-420a-89ac-8aad18ba65fd-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:48.673109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:48.673081    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"
Sep 11 12:41:48.673109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:48.673095    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h" event={"ID":"1371a9bd-db3a-420a-89ac-8aad18ba65fd","Type":"ContainerDied","Data":"e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a"}
Sep 11 12:41:48.673356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:48.673142    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e06d87872a46c8545ec0d440506b902ed325a6fd9fcdc2785f1329910a9ccd3a"
Sep 11 12:41:51.519062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.519010    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:51.589959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.589918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:51.690496 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.690467    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:51.708070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.708024    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"]
Sep 11 12:41:51.713921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.713901    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47131dfa-k6n2h"]
Sep 11 12:41:51.756562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.756536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:51.878266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.878182    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1371a9bd-db3a-420a-89ac-8aad18ba65fd" path="/var/lib/kubelet/pods/1371a9bd-db3a-420a-89ac-8aad18ba65fd/volumes"
Sep 11 12:41:51.924942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.924908    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:51.925204 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.925177    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy" containerID="cri-o://7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9" gracePeriod=30
Sep 11 12:41:51.980571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:51.980540    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:52.474684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.474649    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:52.844016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.843979    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:41:52.844596 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844575    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:52.844639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:52.844639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844629    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1371a9bd-db3a-420a-89ac-8aad18ba65fd" containerName="revoke-keys"
Sep 11 12:41:52.844639 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844637    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1371a9bd-db3a-420a-89ac-8aad18ba65fd" containerName="revoke-keys"
Sep 11 12:41:52.844769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844757    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="00dafb6e-316b-4613-a470-fab2480f754f" containerName="istio-proxy"
Sep 11 12:41:52.844804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.844775    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1371a9bd-db3a-420a-89ac-8aad18ba65fd" containerName="revoke-keys"
Sep 11 12:41:52.849420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.849399    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.852073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.852054    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bdb1ecfc-openshift-default-dockercfg-2vdgv\""
Sep 11 12:41:52.859406 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.859386    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:41:52.867052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.867003    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:52.878701 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.878676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.878797 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.878741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.878880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.878854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rv4w\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.878933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.878914    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.879159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.879140    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.879233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.879183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.879314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.879295    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.879368 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.879353    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.879410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.879384    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980459 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rv4w\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.980993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.980899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.981245 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.981135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.981388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.981358    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.981534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.981482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.981602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.981545    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.983514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.983486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.983665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.983646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.989301 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.989279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:52.989394 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:52.989311    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rv4w\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w\") pod \"e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") " pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:53.074953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.074920    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:53.160332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.160240    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:53.438267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.438239    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:41:53.439142 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:41:53.439117    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986e5cd5_521d_4963_a303_7640e21983a5.slice/crio-8cbc622cd4b310b7180bd5e99566a7c71dc6a1d06a1d3efdeba8200608fa24a0 WatchSource:0}: Error finding container 8cbc622cd4b310b7180bd5e99566a7c71dc6a1d06a1d3efdeba8200608fa24a0: Status 404 returned error can't find the container with id 8cbc622cd4b310b7180bd5e99566a7c71dc6a1d06a1d3efdeba8200608fa24a0
Sep 11 12:41:53.441295 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.441264    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:53.441388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.441320    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:53.441388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.441350    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:41:53.703124 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.703012    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerStarted","Data":"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"}
Sep 11 12:41:53.703124 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.703100    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerStarted","Data":"8cbc622cd4b310b7180bd5e99566a7c71dc6a1d06a1d3efdeba8200608fa24a0"}
Sep 11 12:41:53.724989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:53.724933    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podStartSLOduration=1.7249145559999999 podStartE2EDuration="1.724914556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:53.723190446 +0000 UTC m=+906.367083105" watchObservedRunningTime="2026-09-11 12:41:53.724914556 +0000 UTC m=+906.368807229"
Sep 11 12:41:54.161453 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:54.161422    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:54.165973 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:54.165947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:54.709721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:54.709695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:54.710700 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:54.710678    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:41:55.150292 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:55.150258    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:55.246633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:55.246595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:56.277445 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:56.277413    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:56.377688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:56.377655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:56.532113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:56.532008    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:56.764373 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:56.764340    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:56.863801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:56.863716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:41:57.176878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.176853    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:57.220127 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220095    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220253 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220155    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220253 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220190    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220270    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9gw\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220300    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220311    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:57.220377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220339    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220588 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220398    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220588 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220452    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220588 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo\") pod \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\" (UID: \"9d856a31-d3b3-4baa-bf6e-bee60ef22d01\") "
Sep 11 12:41:57.220747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220447    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:57.220747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220609    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:57.220747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220470    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:57.220899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.220752    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:57.221307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.221286    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.221422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.221312    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.221422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.221325    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.221422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.221338    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.221422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.221350    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.222974 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.222944    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw" (OuterVolumeSpecName: "kube-api-access-6b9gw") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "kube-api-access-6b9gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:57.223270 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.223239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:41:57.226933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.226905    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:57.227066 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.227004    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d856a31-d3b3-4baa-bf6e-bee60ef22d01" (UID: "9d856a31-d3b3-4baa-bf6e-bee60ef22d01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:41:57.322074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.322019    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.322431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.322078    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.322431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.322090    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.322431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.322099    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9gw\" (UniqueName: \"kubernetes.io/projected/9d856a31-d3b3-4baa-bf6e-bee60ef22d01-kube-api-access-6b9gw\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:41:57.731269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.731235    2584 generic.go:356] "Generic (PLEG): container finished" podID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerID="7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9" exitCode=0
Sep 11 12:41:57.731439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.731286    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"
Sep 11 12:41:57.731439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.731321    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerDied","Data":"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"}
Sep 11 12:41:57.731439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.731378    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk" event={"ID":"9d856a31-d3b3-4baa-bf6e-bee60ef22d01","Type":"ContainerDied","Data":"ed1b11ddf24158098167495d9c19a73304a14b0d76c46f7b5fd505c125eec7f1"}
Sep 11 12:41:57.731439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.731406    2584 scope.go:117] "RemoveContainer" containerID="7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"
Sep 11 12:41:57.742989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.742970    2584 scope.go:117] "RemoveContainer" containerID="2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"
Sep 11 12:41:57.753209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.753188    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:57.754794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.754777    2584 scope.go:117] "RemoveContainer" containerID="7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"
Sep 11 12:41:57.755119 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:41:57.755086    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9\": container with ID starting with 7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9 not found: ID does not exist" containerID="7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"
Sep 11 12:41:57.755195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.755123    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9"} err="failed to get container status \"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9\": rpc error: code = NotFound desc = could not find container \"7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9\": container with ID starting with 7f05beb9b5b8968d8f4477b2ddec7c53b4dfb413801cd7fb2c0651a11aba1cf9 not found: ID does not exist"
Sep 11 12:41:57.755195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.755142    2584 scope.go:117] "RemoveContainer" containerID="2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"
Sep 11 12:41:57.755416 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:41:57.755401    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f\": container with ID starting with 2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f not found: ID does not exist" containerID="2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"
Sep 11 12:41:57.755473 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.755419    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f"} err="failed to get container status \"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f\": rpc error: code = NotFound desc = could not find container \"2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f\": container with ID starting with 2daf35cd221ec78a0b73d15b0e9de8b0946ed7fc3874706a0bff0410bf2ba61f not found: ID does not exist"
Sep 11 12:41:57.757052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.757020    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-47131dfa-gw-openshift-default-6b87787f48-lfprk"]
Sep 11 12:41:57.877438 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:41:57.877412    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" path="/var/lib/kubelet/pods/9d856a31-d3b3-4baa-bf6e-bee60ef22d01/volumes"
Sep 11 12:42:02.288564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:02.288530    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:42:04.382575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:04.382531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:13.837537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.837489    2584 generic.go:356] "Generic (PLEG): container finished" podID="986e5cd5-521d-4963-a303-7640e21983a5" containerID="668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c" exitCode=0
Sep 11 12:42:13.838087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.837573    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerDied","Data":"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"}
Sep 11 12:42:13.838173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.838140    2584 scope.go:117] "RemoveContainer" containerID="668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"
Sep 11 12:42:13.839538 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.839504    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:13.839655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.839595    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:13.839655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:13.839647    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:14.850020 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:14.849973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerStarted","Data":"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"}
Sep 11 12:42:15.161457 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:15.161369    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:15.161705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:15.161683    2584 patch_prober.go:28] interesting pod/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:42:15.161838 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:15.161819    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 11 12:42:16.161269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:16.161230    2584 patch_prober.go:28] interesting pod/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:42:16.161640 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:16.161302    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 11 12:42:17.160951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:17.160919    2584 patch_prober.go:28] interesting pod/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:42:17.161149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:17.160987    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 11 12:42:18.161619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:18.161585    2584 patch_prober.go:28] interesting pod/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:42:18.161987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:18.161637    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 11 12:42:19.160606 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:19.160573    2584 patch_prober.go:28] interesting pod/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:42:19.160866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:19.160625    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 11 12:42:20.192564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.192526    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:20.193062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.193040    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:20.193621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.193602    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:20.314023 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.313985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:20.836569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836525    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"]
Sep 11 12:42:20.836909 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836897    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.836949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836911    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.836949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836928    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.836949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836933    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.837065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836992    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.837065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.836999    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d856a31-d3b3-4baa-bf6e-bee60ef22d01" containerName="istio-proxy"
Sep 11 12:42:20.840225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.840207    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:20.843456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.843430    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:42:20.843714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.843699    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:42:20.858694 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.858674    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"]
Sep 11 12:42:20.947074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:20.947044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k\" (UID: \"e6ca941a-e115-4b62-bd8a-4b3e221381b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:21.047982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.047952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k\" (UID: \"e6ca941a-e115-4b62-bd8a-4b3e221381b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:21.048571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.048550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k\" (UID: \"e6ca941a-e115-4b62-bd8a-4b3e221381b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:21.150858 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.150786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:21.423678 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.423646    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"]
Sep 11 12:42:21.426109 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:42:21.426080    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ca941a_e115_4b62_bd8a_4b3e221381b9.slice/crio-cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6 WatchSource:0}: Error finding container cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6: Status 404 returned error can't find the container with id cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6
Sep 11 12:42:21.588447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.588411    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:42:21.896661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.896621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k" event={"ID":"e6ca941a-e115-4b62-bd8a-4b3e221381b9","Type":"ContainerStarted","Data":"99c3db058414f4bfe54be66fccd6e6fba31f480ceb6c66180724506739fe3c53"}
Sep 11 12:42:21.896824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.896674    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k" event={"ID":"e6ca941a-e115-4b62-bd8a-4b3e221381b9","Type":"ContainerStarted","Data":"cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6"}
Sep 11 12:42:21.914883 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:21.914835    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k" podStartSLOduration=1.914822258 podStartE2EDuration="1.914822258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:21.912756863 +0000 UTC m=+934.556649521" watchObservedRunningTime="2026-09-11 12:42:21.914822258 +0000 UTC m=+934.558714914"
Sep 11 12:42:22.903530 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:22.903501    2584 generic.go:356] "Generic (PLEG): container finished" podID="e6ca941a-e115-4b62-bd8a-4b3e221381b9" containerID="99c3db058414f4bfe54be66fccd6e6fba31f480ceb6c66180724506739fe3c53" exitCode=0
Sep 11 12:42:22.903890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:22.903552    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k" event={"ID":"e6ca941a-e115-4b62-bd8a-4b3e221381b9","Type":"ContainerDied","Data":"99c3db058414f4bfe54be66fccd6e6fba31f480ceb6c66180724506739fe3c53"}
Sep 11 12:42:24.047573 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.047545    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:24.174833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.174757    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca\") pod \"e6ca941a-e115-4b62-bd8a-4b3e221381b9\" (UID: \"e6ca941a-e115-4b62-bd8a-4b3e221381b9\") "
Sep 11 12:42:24.175117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.175094    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6ca941a-e115-4b62-bd8a-4b3e221381b9" (UID: "e6ca941a-e115-4b62-bd8a-4b3e221381b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:24.275835 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.275808    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ca941a-e115-4b62-bd8a-4b3e221381b9-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:24.915942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.915915    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"
Sep 11 12:42:24.916121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.915960    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k" event={"ID":"e6ca941a-e115-4b62-bd8a-4b3e221381b9","Type":"ContainerDied","Data":"cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6"}
Sep 11 12:42:24.916121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:24.916007    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cddcac0fc0e747688b7f480cd6400edcf52d5d195d18b66286331a0dc977d2b6"
Sep 11 12:42:26.840405 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:26.840371    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:26.939654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:26.939616    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:27.032726 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:27.032697    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"]
Sep 11 12:42:27.035121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:27.035097    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:27.036259 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:27.036238    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bdb1ecfc-qb99k"]
Sep 11 12:42:27.098093 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:27.098011    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:27.877350 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:27.877318    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ca941a-e115-4b62-bd8a-4b3e221381b9" path="/var/lib/kubelet/pods/e6ca941a-e115-4b62-bd8a-4b3e221381b9/volumes"
Sep 11 12:42:28.098023 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.097988    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:42:28.098272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.098240    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy" containerID="cri-o://0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6" gracePeriod=30
Sep 11 12:42:28.121552 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.121527    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:28.333688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.333656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:28.536263 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.536228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:28.824425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.824393    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:42:28.825021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.825001    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ca941a-e115-4b62-bd8a-4b3e221381b9" containerName="revoke-keys"
Sep 11 12:42:28.825021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.825020    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ca941a-e115-4b62-bd8a-4b3e221381b9" containerName="revoke-keys"
Sep 11 12:42:28.825215 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.825135    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ca941a-e115-4b62-bd8a-4b3e221381b9" containerName="revoke-keys"
Sep 11 12:42:28.828942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.828916    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:28.831717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.831699    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d76886ba-openshift-default-dockercfg-vpgg6\""
Sep 11 12:42:28.846054 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.846011    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:42:28.864993 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:28.864966    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:29.016792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.016761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.016792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.016796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.016815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.016831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d52xt\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.016995    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.017045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.017075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.017114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.017283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.017138    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118348    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d52xt\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118697    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.118854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.119092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.118925    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.119092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.119074    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.119169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.119126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.120884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.120860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.121007 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.120965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.126794 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.126770    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.127052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.127011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d52xt\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt\") pod \"e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") " pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.138714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.138695    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:29.376366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.376274    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:29.414370 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.414342    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:42:29.415244 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:42:29.415219    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0df4cc3_aecf_4daa_97b8_33ffa13957ab.slice/crio-d85235bacecf4d52d058b6f19af066054bdb46b740595bc18b4210691564f738 WatchSource:0}: Error finding container d85235bacecf4d52d058b6f19af066054bdb46b740595bc18b4210691564f738: Status 404 returned error can't find the container with id d85235bacecf4d52d058b6f19af066054bdb46b740595bc18b4210691564f738
Sep 11 12:42:29.417801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.417768    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:29.417917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.417842    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:29.417917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.417894    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:29.953709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.953673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerStarted","Data":"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"}
Sep 11 12:42:29.953894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.953733    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerStarted","Data":"d85235bacecf4d52d058b6f19af066054bdb46b740595bc18b4210691564f738"}
Sep 11 12:42:29.977515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:29.977467    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podStartSLOduration=1.9774534990000001 podStartE2EDuration="1.977453499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:29.974881934 +0000 UTC m=+942.618774593" watchObservedRunningTime="2026-09-11 12:42:29.977453499 +0000 UTC m=+942.621346155"
Sep 11 12:42:30.139317 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:30.139287    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:30.144181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:30.144157    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:30.959705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:30.959673    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:30.960651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:30.960629    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:31.346297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:31.346254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:31.439092 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:31.439051    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:32.488976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:32.488932    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:32.585365 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:32.585332    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:32.746272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:32.746179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:32.995969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:32.995924    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:33.089276 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.089187    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:33.375656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.375632    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:33.461890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.461861    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.461944    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rv4w\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.461984    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462007    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462129    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462189    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462217    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462186    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462244    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462274    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token\") pod \"986e5cd5-521d-4963-a303-7640e21983a5\" (UID: \"986e5cd5-521d-4963-a303-7640e21983a5\") "
Sep 11 12:42:33.462668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462409    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:42:33.462668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462393    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:42:33.462668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462538    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:42:33.462668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462547    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:33.462843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462681    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.462843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462701    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.462843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462715    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/986e5cd5-521d-4963-a303-7640e21983a5-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.462843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462728    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.462843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.462740    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.464149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.464118    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:42:33.464630 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.464610    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w" (OuterVolumeSpecName: "kube-api-access-7rv4w") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "kube-api-access-7rv4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:42:33.464714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.464660    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:42:33.464853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.464834    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "986e5cd5-521d-4963-a303-7640e21983a5" (UID: "986e5cd5-521d-4963-a303-7640e21983a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:42:33.563741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.563711    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rv4w\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-kube-api-access-7rv4w\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.563741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.563738    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/986e5cd5-521d-4963-a303-7640e21983a5-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.564102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.563751    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/986e5cd5-521d-4963-a303-7640e21983a5-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.564102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.563762    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/986e5cd5-521d-4963-a303-7640e21983a5-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:33.978869 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.978834    2584 generic.go:356] "Generic (PLEG): container finished" podID="986e5cd5-521d-4963-a303-7640e21983a5" containerID="0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6" exitCode=0
Sep 11 12:42:33.979060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.978875    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"
Sep 11 12:42:33.979060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.978901    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerDied","Data":"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"}
Sep 11 12:42:33.979060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.978955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj" event={"ID":"986e5cd5-521d-4963-a303-7640e21983a5","Type":"ContainerDied","Data":"8cbc622cd4b310b7180bd5e99566a7c71dc6a1d06a1d3efdeba8200608fa24a0"}
Sep 11 12:42:33.979060 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.978981    2584 scope.go:117] "RemoveContainer" containerID="0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"
Sep 11 12:42:33.990298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.990279    2584 scope.go:117] "RemoveContainer" containerID="668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"
Sep 11 12:42:33.996317 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.996297    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:42:33.998517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.998491    2584 scope.go:117] "RemoveContainer" containerID="0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"
Sep 11 12:42:33.998938 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:42:33.998901    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6\": container with ID starting with 0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6 not found: ID does not exist" containerID="0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"
Sep 11 12:42:33.999061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.998948    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6"} err="failed to get container status \"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6\": rpc error: code = NotFound desc = could not find container \"0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6\": container with ID starting with 0e79d25dcc5748268e284acc8f62d7d5b311f85625042daff7a5f0589105b4e6 not found: ID does not exist"
Sep 11 12:42:33.999061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.998972    2584 scope.go:117] "RemoveContainer" containerID="668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"
Sep 11 12:42:33.999307 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:42:33.999286    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c\": container with ID starting with 668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c not found: ID does not exist" containerID="668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"
Sep 11 12:42:33.999390 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:33.999315    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c"} err="failed to get container status \"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c\": rpc error: code = NotFound desc = could not find container \"668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c\": container with ID starting with 668944f83038965dc31d50a0723b5aacffe96ca61501b7aaab989e88cfc3f83c not found: ID does not exist"
Sep 11 12:42:34.003400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:34.003379    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bdb1ecfc-openshift-default-6df9dffdd-fkjpj"]
Sep 11 12:42:35.877127 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:35.877096    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986e5cd5-521d-4963-a303-7640e21983a5" path="/var/lib/kubelet/pods/986e5cd5-521d-4963-a303-7640e21983a5/volumes"
Sep 11 12:42:41.784444 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:41.784408    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:42:44.957061 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:44.957003    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:47.040053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:47.036131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:49.470415 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:49.470375    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:42:49.481893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:49.481859    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:50.108827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:50.108790    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:51.007132 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.007095    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:51.127582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.127544    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"]
Sep 11 12:42:51.128137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128119    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.128240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128139    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.128240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128156    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.128240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128164    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.128401 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128274    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.128401 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.128288    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="986e5cd5-521d-4963-a303-7640e21983a5" containerName="istio-proxy"
Sep 11 12:42:51.131819 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.131798    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:51.135193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.134982    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:42:51.135193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.135096    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:42:51.137352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.137323    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"]
Sep 11 12:42:51.220049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.220006    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-9878a9-6qd5m\" (UID: \"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:51.320567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.320480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:51.320733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.320583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-9878a9-6qd5m\" (UID: \"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:51.321207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.321186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-9878a9-6qd5m\" (UID: \"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:51.444226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.444190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:51.736977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:51.718884    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"]
Sep 11 12:42:51.736977 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:42:51.721812    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7285bb7e_c9a4_4343_80fe_a28d6f3f72a5.slice/crio-67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a WatchSource:0}: Error finding container 67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a: Status 404 returned error can't find the container with id 67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a
Sep 11 12:42:52.099131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.099070    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m" event={"ID":"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5","Type":"ContainerStarted","Data":"625d1332ea7fdb7814bc6913ef65dbf8a77528e2576788d2d641752c2353e8aa"}
Sep 11 12:42:52.099537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.099144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m" event={"ID":"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5","Type":"ContainerStarted","Data":"67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a"}
Sep 11 12:42:52.101423 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.101398    2584 generic.go:356] "Generic (PLEG): container finished" podID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerID="4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226" exitCode=0
Sep 11 12:42:52.101547 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.101475    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerDied","Data":"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"}
Sep 11 12:42:52.101937 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.101920    2584 scope.go:117] "RemoveContainer" containerID="4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"
Sep 11 12:42:52.103269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.103240    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:52.103347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.103319    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:52.103388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.103361    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:42:52.114777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:52.114728    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m" podStartSLOduration=1.114711115 podStartE2EDuration="1.114711115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:52.113305292 +0000 UTC m=+964.757197950" watchObservedRunningTime="2026-09-11 12:42:52.114711115 +0000 UTC m=+964.758603773"
Sep 11 12:42:53.108440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.108406    2584 generic.go:356] "Generic (PLEG): container finished" podID="7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" containerID="625d1332ea7fdb7814bc6913ef65dbf8a77528e2576788d2d641752c2353e8aa" exitCode=0
Sep 11 12:42:53.108872 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.108493    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m" event={"ID":"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5","Type":"ContainerDied","Data":"625d1332ea7fdb7814bc6913ef65dbf8a77528e2576788d2d641752c2353e8aa"}
Sep 11 12:42:53.110439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.110418    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerStarted","Data":"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"}
Sep 11 12:42:53.149463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.139335    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:53.149463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.139401    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:53.149463 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.139684    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:53.515802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:53.515760    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:42:54.141402 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.141367    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:54.141917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.141885    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:54.344491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.344200    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:54.467561 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.467477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca\") pod \"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5\" (UID: \"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5\") "
Sep 11 12:42:54.467816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.467795    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" (UID: "7285bb7e-c9a4-4343-80fe-a28d6f3f72a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:54.569074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:54.569048    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:42:55.131050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:55.127834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m" event={"ID":"7285bb7e-c9a4-4343-80fe-a28d6f3f72a5","Type":"ContainerDied","Data":"67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a"}
Sep 11 12:42:55.131050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:55.127894    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67e77f6739a8c8a9b510829df486616992ba01079b17acd09781091ef63e341a"
Sep 11 12:42:55.131050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:55.127962    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"
Sep 11 12:42:55.140230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:55.139111    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:55.140230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:55.139171    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:56.118743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.118710    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"]
Sep 11 12:42:56.119163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.119150    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" containerName="revoke-keys"
Sep 11 12:42:56.119214 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.119165    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" containerName="revoke-keys"
Sep 11 12:42:56.119249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.119228    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" containerName="revoke-keys"
Sep 11 12:42:56.121216 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.121199    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:56.124243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.123771    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:42:56.124243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.124083    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:42:56.132135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.132115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"]
Sep 11 12:42:56.148913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.148888    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:56.149571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.149542    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:56.284412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.284376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb\" (UID: \"39232fc2-2dbe-49da-9762-1de9979866fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:56.385685 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.385605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb\" (UID: \"39232fc2-2dbe-49da-9762-1de9979866fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:56.386237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.386219    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb\" (UID: \"39232fc2-2dbe-49da-9762-1de9979866fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:56.449985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.449959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:56.718254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:56.718223    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"]
Sep 11 12:42:56.719300 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:42:56.719275    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39232fc2_2dbe_49da_9762_1de9979866fe.slice/crio-833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329 WatchSource:0}: Error finding container 833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329: Status 404 returned error can't find the container with id 833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329
Sep 11 12:42:57.139697 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:57.139659    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:57.140117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:57.139720    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:57.158488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:57.158457    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb" event={"ID":"39232fc2-2dbe-49da-9762-1de9979866fe","Type":"ContainerStarted","Data":"98cd16c72bba89f42558ba98e4246e65814e83f490877c067598098601036a36"}
Sep 11 12:42:57.158596 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:57.158510    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb" event={"ID":"39232fc2-2dbe-49da-9762-1de9979866fe","Type":"ContainerStarted","Data":"833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329"}
Sep 11 12:42:57.176752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:57.176712    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb" podStartSLOduration=1.176698661 podStartE2EDuration="1.176698661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:57.174992594 +0000 UTC m=+969.818885245" watchObservedRunningTime="2026-09-11 12:42:57.176698661 +0000 UTC m=+969.820591318"
Sep 11 12:42:58.140080 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:58.140047    2584 patch_prober.go:28] interesting pod/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 12:42:58.140451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:58.140116    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 12:42:58.165654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:58.165618    2584 generic.go:356] "Generic (PLEG): container finished" podID="39232fc2-2dbe-49da-9762-1de9979866fe" containerID="98cd16c72bba89f42558ba98e4246e65814e83f490877c067598098601036a36" exitCode=0
Sep 11 12:42:58.165823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:58.165710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb" event={"ID":"39232fc2-2dbe-49da-9762-1de9979866fe","Type":"ContainerDied","Data":"98cd16c72bba89f42558ba98e4246e65814e83f490877c067598098601036a36"}
Sep 11 12:42:59.143562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.143535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:59.143926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.143801    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:59.144367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.144349    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:42:59.305847 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.305821    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:42:59.416176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.416106    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca\") pod \"39232fc2-2dbe-49da-9762-1de9979866fe\" (UID: \"39232fc2-2dbe-49da-9762-1de9979866fe\") "
Sep 11 12:42:59.416419 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.416399    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39232fc2-2dbe-49da-9762-1de9979866fe" (UID: "39232fc2-2dbe-49da-9762-1de9979866fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:59.517447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:42:59.517422    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39232fc2-2dbe-49da-9762-1de9979866fe-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:00.178647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:00.178558    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"
Sep 11 12:43:00.178647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:00.178603    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb" event={"ID":"39232fc2-2dbe-49da-9762-1de9979866fe","Type":"ContainerDied","Data":"833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329"}
Sep 11 12:43:00.179099 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:00.178662    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="833a537556ecb1d7f97cb2da98f4fe474c0615ee3349e05863fec454ec485329"
Sep 11 12:43:01.255089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.255054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:01.780355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.780329    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:01.852616 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.852587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:01.919062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.919000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:01.972628 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.972599    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"]
Sep 11 12:43:01.976470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.976447    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-9878a9-6qd5m"]
Sep 11 12:43:01.984327 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:01.984299    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:02.326509 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:02.326475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:02.734675 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:02.734640    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.308716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.308684    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.407663 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.407613    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.509573 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.509540    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.509933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.509913    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"]
Sep 11 12:43:03.512159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.512141    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d76886ba-dtcqb"]
Sep 11 12:43:03.564646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.564575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.620770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.620736    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:43:03.621160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.621071    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy" containerID="cri-o://99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74" gracePeriod=30
Sep 11 12:43:03.646299 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.646264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:03.877983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.877890    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39232fc2-2dbe-49da-9762-1de9979866fe" path="/var/lib/kubelet/pods/39232fc2-2dbe-49da-9762-1de9979866fe/volumes"
Sep 11 12:43:03.878432 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.878405    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7285bb7e-c9a4-4343-80fe-a28d6f3f72a5" path="/var/lib/kubelet/pods/7285bb7e-c9a4-4343-80fe-a28d6f3f72a5/volumes"
Sep 11 12:43:03.881073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:03.881054    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:43:04.287124 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.287089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:04.414172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.414141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:04.490237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.490200    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" podUID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" containerName="main" containerID="cri-o://664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00" gracePeriod=45
Sep 11 12:43:04.523231 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.523197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:04.763223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.763201    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:43:04.864662 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864601    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.864779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864669    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.864779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864693    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5prlt\" (UniqueName: \"kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.864779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864717    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.864779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864733    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.864779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864755    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home\") pod \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\" (UID: \"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5\") "
Sep 11 12:43:04.865022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:04.865022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.864992    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:04.865155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.865064    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home" (OuterVolumeSpecName: "home") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:04.865201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.865166    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tmp-dir\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.865201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.865184    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-model-cache\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.865201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.865195    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-home\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.866939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.866918    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm" (OuterVolumeSpecName: "dshm") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:04.867185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.867164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:43:04.867287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.867182    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt" (OuterVolumeSpecName: "kube-api-access-5prlt") pod "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" (UID: "d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5"). InnerVolumeSpecName "kube-api-access-5prlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:04.966077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.966049    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-dshm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.966077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.966078    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5prlt\" (UniqueName: \"kubernetes.io/projected/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-kube-api-access-5prlt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.966208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:04.966093    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5-tls-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:05.213633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.213556    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" containerID="664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00" exitCode=0
Sep 11 12:43:05.213633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.213603    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"
Sep 11 12:43:05.213806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.213643    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" event={"ID":"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5","Type":"ContainerDied","Data":"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"}
Sep 11 12:43:05.213806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.213688    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd" event={"ID":"d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5","Type":"ContainerDied","Data":"61446fd2981c1e56e2087fb98ed543933df1d1b5365cf81d74cb937dd75b88d9"}
Sep 11 12:43:05.213806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.213704    2584 scope.go:117] "RemoveContainer" containerID="664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"
Sep 11 12:43:05.223751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.223731    2584 scope.go:117] "RemoveContainer" containerID="664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"
Sep 11 12:43:05.224089 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:43:05.224069    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00\": container with ID starting with 664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00 not found: ID does not exist" containerID="664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"
Sep 11 12:43:05.224174 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.224096    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00"} err="failed to get container status \"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00\": rpc error: code = NotFound desc = could not find container \"664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00\": container with ID starting with 664cc25963332de6fa482abe9398c9d15d872524187f4dc94c7efa07f76c9c00 not found: ID does not exist"
Sep 11 12:43:05.235922 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.235900    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:43:05.241756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.241735    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-50eee0c3-kserve-656b8b7745-clxhd"]
Sep 11 12:43:05.838900 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.838864    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:05.877074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:05.877023    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" path="/var/lib/kubelet/pods/d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5/volumes"
Sep 11 12:43:08.270766 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.270732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:08.340371 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.340342    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:08.501016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.500985    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:43:08.501201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.501177    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" containerID="cri-o://29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76" gracePeriod=30
Sep 11 12:43:08.597291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.597205    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:08.870378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.870352    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:43:08.935753 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:08.935726    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:09.001332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001310    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001356    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d52xt\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001382    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001489    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001532    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001565    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001591    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001665    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001692    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket\") pod \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\" (UID: \"c0df4cc3-aecf-4daa-97b8-33ffa13957ab\") "
Sep 11 12:43:09.001824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001791    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:09.001889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001812    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001963    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.001992    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002009    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002153    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002173    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002188    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002202    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.002236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.002213    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.003521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.003492    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:43:09.003827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.003798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:09.003827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.003818    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt" (OuterVolumeSpecName: "kube-api-access-d52xt") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "kube-api-access-d52xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:09.004018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.003998    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0df4cc3-aecf-4daa-97b8-33ffa13957ab" (UID: "c0df4cc3-aecf-4daa-97b8-33ffa13957ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:09.103359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.103306    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.103359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.103328    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.103359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.103337    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d52xt\" (UniqueName: \"kubernetes.io/projected/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-kube-api-access-d52xt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.103359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.103345    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0df4cc3-aecf-4daa-97b8-33ffa13957ab-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:09.197499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197470    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:43:09.197828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197814    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.197828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197828    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197841    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197847    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197852    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39232fc2-2dbe-49da-9762-1de9979866fe" containerName="revoke-keys"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197863    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="39232fc2-2dbe-49da-9762-1de9979866fe" containerName="revoke-keys"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197878    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" containerName="main"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197882    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" containerName="main"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197945    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197952    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3dd4806-a1b4-4baf-ad8d-0c326b2bbea5" containerName="main"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197961    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="39232fc2-2dbe-49da-9762-1de9979866fe" containerName="revoke-keys"
Sep 11 12:43:09.197969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.197967    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerName="istio-proxy"
Sep 11 12:43:09.199965 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.199944    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.202499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.202483    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-b8dbb2-openshift-default-dockercfg-4vwzl\""
Sep 11 12:43:09.212948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.212927    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:43:09.226854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.226807    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:09.240274 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.240250    2584 generic.go:356] "Generic (PLEG): container finished" podID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" containerID="99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74" exitCode=0
Sep 11 12:43:09.240382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.240311    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"
Sep 11 12:43:09.240442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.240315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerDied","Data":"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"}
Sep 11 12:43:09.240442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.240424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn" event={"ID":"c0df4cc3-aecf-4daa-97b8-33ffa13957ab","Type":"ContainerDied","Data":"d85235bacecf4d52d058b6f19af066054bdb46b740595bc18b4210691564f738"}
Sep 11 12:43:09.240540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.240445    2584 scope.go:117] "RemoveContainer" containerID="99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"
Sep 11 12:43:09.250452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.250437    2584 scope.go:117] "RemoveContainer" containerID="4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"
Sep 11 12:43:09.258775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.258755    2584 scope.go:117] "RemoveContainer" containerID="99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"
Sep 11 12:43:09.259003 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:43:09.258987    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74\": container with ID starting with 99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74 not found: ID does not exist" containerID="99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"
Sep 11 12:43:09.259107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.259009    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74"} err="failed to get container status \"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74\": rpc error: code = NotFound desc = could not find container \"99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74\": container with ID starting with 99696bd0649114dcf129c39a22117e0002d92f7a55762206416e182f6d3bae74 not found: ID does not exist"
Sep 11 12:43:09.259107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.259051    2584 scope.go:117] "RemoveContainer" containerID="4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"
Sep 11 12:43:09.259341 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:43:09.259317    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226\": container with ID starting with 4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226 not found: ID does not exist" containerID="4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"
Sep 11 12:43:09.259413 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.259351    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226"} err="failed to get container status \"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226\": rpc error: code = NotFound desc = could not find container \"4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226\": container with ID starting with 4e57ea3f9f3d5f61050ee6d222b901405c95d3ee54f18092fe19cb557f261226 not found: ID does not exist"
Sep 11 12:43:09.262804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.262783    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:43:09.266161 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.266143    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d76886ba-openshift-default-759bff4b6d-f4frn"]
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.305789    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.305888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.305992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306076    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306186    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306258    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.307919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.306322    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ls2k\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407351 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407351 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407317    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ls2k\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407569 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407562    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407846    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.407905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.407892    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.408208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.408186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.409700 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.409678    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.409938 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.409918    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.422040 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.422006    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ls2k\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.424214 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.424188    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token\") pod \"e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") " pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.511415 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.511390    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:09.756221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.756184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:09.787480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.787454    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:43:09.789871 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:43:09.789841    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063a255a_a3f8_4214_87ed_40c0234a9245.slice/crio-29b8c40485ee7697de79b18c9878eddfa69c9de6b22ca4997f565ae19fe7a2e7 WatchSource:0}: Error finding container 29b8c40485ee7697de79b18c9878eddfa69c9de6b22ca4997f565ae19fe7a2e7: Status 404 returned error can't find the container with id 29b8c40485ee7697de79b18c9878eddfa69c9de6b22ca4997f565ae19fe7a2e7
Sep 11 12:43:09.792282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.792227    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:09.792412 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.792388    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:09.793063 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.792480    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:09.877822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:09.877793    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0df4cc3-aecf-4daa-97b8-33ffa13957ab" path="/var/lib/kubelet/pods/c0df4cc3-aecf-4daa-97b8-33ffa13957ab/volumes"
Sep 11 12:43:10.247934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:10.247893    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerStarted","Data":"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"}
Sep 11 12:43:10.248100 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:10.247951    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerStarted","Data":"29b8c40485ee7697de79b18c9878eddfa69c9de6b22ca4997f565ae19fe7a2e7"}
Sep 11 12:43:10.269610 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:10.269556    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podStartSLOduration=1.269541356 podStartE2EDuration="1.269541356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:43:10.267345805 +0000 UTC m=+982.911238454" watchObservedRunningTime="2026-09-11 12:43:10.269541356 +0000 UTC m=+982.913434012"
Sep 11 12:43:10.511821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:10.511735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:10.516444 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:10.516421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:11.253736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:11.253706    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:11.254611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:11.254590    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:11.847426 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:11.847381    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:11.905483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:11.905453    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:11.993325 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:11.993292    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:12.082505 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:12.082474    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:12.194557 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:12.194480    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:12.285775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:12.285748    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:12.558003 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:12.557969    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:13.356425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.356392    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:13.469779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.469743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:13.637560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.637528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:13.748385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.748364    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:43:13.849916 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.849887    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.849935    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.849972    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.849998    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850042    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850103    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850137    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v7dg\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850202    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850228    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert\") pod \"83a39193-d29a-4af7-9532-0bc0d0494249\" (UID: \"83a39193-d29a-4af7-9532-0bc0d0494249\") "
Sep 11 12:43:13.850326 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850228    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:13.850582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850332    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data" (OuterVolumeSpecName: "istio-data") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:13.850582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850350    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:13.850582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850486    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:13.850757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850600    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.850757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850616    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.850757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850630    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.850757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850642    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.850757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.850658    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:43:13.852152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.852124    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:43:13.852631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.852610    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token" (OuterVolumeSpecName: "istio-token") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:13.852712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.852628    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg" (OuterVolumeSpecName: "kube-api-access-4v7dg") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "kube-api-access-4v7dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:13.852712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.852678    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83a39193-d29a-4af7-9532-0bc0d0494249" (UID: "83a39193-d29a-4af7-9532-0bc0d0494249"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:43:13.876927 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.876872    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:13.951105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.951074    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83a39193-d29a-4af7-9532-0bc0d0494249-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.951105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.951099    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83a39193-d29a-4af7-9532-0bc0d0494249-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.951309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.951113    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v7dg\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-kube-api-access-4v7dg\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.951309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.951153    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83a39193-d29a-4af7-9532-0bc0d0494249-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.951309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.951165    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83a39193-d29a-4af7-9532-0bc0d0494249-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:43:13.978106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:13.978066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:14.272362 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.272330    2584 generic.go:356] "Generic (PLEG): container finished" podID="83a39193-d29a-4af7-9532-0bc0d0494249" containerID="29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76" exitCode=0
Sep 11 12:43:14.272532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.272375    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"
Sep 11 12:43:14.272532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.272414    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerDied","Data":"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"}
Sep 11 12:43:14.272532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.272467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" event={"ID":"83a39193-d29a-4af7-9532-0bc0d0494249","Type":"ContainerDied","Data":"bd7c63c59d5949f12c0a2040c3604861e1b0c29f92736937187c701312862ca3"}
Sep 11 12:43:14.272532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.272491    2584 scope.go:117] "RemoveContainer" containerID="29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"
Sep 11 12:43:14.281459 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.281433    2584 scope.go:117] "RemoveContainer" containerID="f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"
Sep 11 12:43:14.296173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.296151    2584 scope.go:117] "RemoveContainer" containerID="29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"
Sep 11 12:43:14.296349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.296324    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:43:14.296463 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:43:14.296444    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76\": container with ID starting with 29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76 not found: ID does not exist" containerID="29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"
Sep 11 12:43:14.296511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.296471    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76"} err="failed to get container status \"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76\": rpc error: code = NotFound desc = could not find container \"29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76\": container with ID starting with 29f9e7678334bf121aed27272cad0da92c2a9b510566fa2f854cc82edd70ea76 not found: ID does not exist"
Sep 11 12:43:14.296511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.296488    2584 scope.go:117] "RemoveContainer" containerID="f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"
Sep 11 12:43:14.296750 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:43:14.296731    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165\": container with ID starting with f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165 not found: ID does not exist" containerID="f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"
Sep 11 12:43:14.296788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.296757    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165"} err="failed to get container status \"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165\": rpc error: code = NotFound desc = could not find container \"f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165\": container with ID starting with f5fb1e6bb8a125434b3728ad3edd852cd4715c524fbab533013ef323519ce165 not found: ID does not exist"
Sep 11 12:43:14.298489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.298470    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb"]
Sep 11 12:43:14.710522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.710431    2584 patch_prober.go:28] interesting pod/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:43:14.710522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:14.710502    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-9878a9-openshift-default-86f88cb694-qtxtb" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:43:15.876900 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:15.876868    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" path="/var/lib/kubelet/pods/83a39193-d29a-4af7-9532-0bc0d0494249/volumes"
Sep 11 12:43:19.585128 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:19.585091    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:43:27.295185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:27.295145    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:43:27.295576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:27.295196    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:43:29.381310 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.381277    2584 generic.go:356] "Generic (PLEG): container finished" podID="063a255a-a3f8-4214-87ed-40c0234a9245" containerID="9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c" exitCode=0
Sep 11 12:43:29.381740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.381362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerDied","Data":"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"}
Sep 11 12:43:29.381933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.381915    2584 scope.go:117] "RemoveContainer" containerID="9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"
Sep 11 12:43:29.383157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.383129    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:29.383234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.383199    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:29.383234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:29.383231    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:43:30.389396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:30.389359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerStarted","Data":"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"}
Sep 11 12:43:30.511961 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:30.511924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:30.512246 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:30.512225    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:43:30.512337 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:30.512274    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 12:43:30.841911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:30.841876    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:31.512064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:31.512011    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:43:31.512492 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:31.512089    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 12:43:32.512210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:32.512175    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:43:32.512585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:32.512233    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 12:43:33.512384 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:33.512347    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:43:33.512837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:33.512405    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 12:43:34.512006 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:34.511970    2584 patch_prober.go:28] interesting pod/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:43:34.512195 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:34.512048    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 12:43:35.515486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:35.515456    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:35.515943 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:35.515844    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:35.516696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:35.516672    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:43:37.056824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:37.056788    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:38.386115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:38.386079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:43:38.448486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:38.448454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:44.154311 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:44.154251    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:44.215275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:44.215241    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:44.288448 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:44.288412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:44.389617 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:44.389584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:50.381087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:50.381044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:53.581655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:53.581617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:43:55.566637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.566600    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:43:55.567101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567086    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.567156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567103    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.567156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567112    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.567156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567118    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.567258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567183    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.567258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.567192    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a39193-d29a-4af7-9532-0bc0d0494249" containerName="istio-proxy"
Sep 11 12:43:55.571466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.571449    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.575595 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.575573    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b8dbb2\"/\"default-dockercfg-bw292\""
Sep 11 12:43:55.575721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.575624    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b8dbb2\"/\"openshift-service-ca.crt\""
Sep 11 12:43:55.575721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.575627    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b8dbb2\"/\"kube-root-ca.crt\""
Sep 11 12:43:55.575721 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.575593    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b8dbb2\"/\"explicit-model-b8dbb2-kserve-self-signed-certs\""
Sep 11 12:43:55.581847 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.581823    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:43:55.617599 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.617703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617604    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.617703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617629    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dws\" (UniqueName: \"kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.617703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617683    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.617818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.617853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.617828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.686564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.686530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:43:55.718984 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.718960    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dws\" (UniqueName: \"kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.718992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719329 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719613    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719688    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.719734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.719721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.721344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.721318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.721438 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.721422    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.728298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.728274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dws\" (UniqueName: \"kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws\") pod \"explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") " pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:55.883201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:55.883114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:43:56.163997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:56.163976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:43:56.166657 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:43:56.166633    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbb26e3d_dd41_4253_9e31_1572bb33b80d.slice/crio-6bbef3634657b53eb7c8e01fd3c76b2da635f63c01c931409f1831abda6268ba WatchSource:0}: Error finding container 6bbef3634657b53eb7c8e01fd3c76b2da635f63c01c931409f1831abda6268ba: Status 404 returned error can't find the container with id 6bbef3634657b53eb7c8e01fd3c76b2da635f63c01c931409f1831abda6268ba
Sep 11 12:43:56.551936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:56.551900    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" event={"ID":"cbb26e3d-dd41-4253-9e31-1572bb33b80d","Type":"ContainerStarted","Data":"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"}
Sep 11 12:43:56.551936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:56.551942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" event={"ID":"cbb26e3d-dd41-4253-9e31-1572bb33b80d","Type":"ContainerStarted","Data":"6bbef3634657b53eb7c8e01fd3c76b2da635f63c01c931409f1831abda6268ba"}
Sep 11 12:43:56.573894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:43:56.573835    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" podStartSLOduration=1.573816772 podStartE2EDuration="1.573816772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:43:56.571667175 +0000 UTC m=+1029.215559831" watchObservedRunningTime="2026-09-11 12:43:56.573816772 +0000 UTC m=+1029.217709472"
Sep 11 12:44:00.154850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:00.154818    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:05.884109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:05.884077    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:05.884109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:05.884111    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:05.895948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:05.895923    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:06.229212 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:06.229118    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:06.331454 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:06.331417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:06.429505 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:06.429468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:06.622645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:06.622620    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:09.778201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:09.778165    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:44:10.121017 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.120939    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:44:10.134048 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.133983    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:10.238251 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.238216    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"]
Sep 11 12:44:10.241957 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.241937    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:10.244583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.244561    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:44:10.244678 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.244614    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:44:10.248947 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.248927    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"]
Sep 11 12:44:10.359456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.359430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn\" (UID: \"35ca78d9-004e-4439-b475-9537ec7f2a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:10.460908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.460837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn\" (UID: \"35ca78d9-004e-4439-b475-9537ec7f2a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:10.461405 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.461387    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn\" (UID: \"35ca78d9-004e-4439-b475-9537ec7f2a81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:10.554223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.554190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:10.829619 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:10.829595    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"]
Sep 11 12:44:10.831717 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:44:10.831687    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ca78d9_004e_4439_b475_9537ec7f2a81.slice/crio-f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538 WatchSource:0}: Error finding container f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538: Status 404 returned error can't find the container with id f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538
Sep 11 12:44:11.644247 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:11.644220    2584 generic.go:356] "Generic (PLEG): container finished" podID="35ca78d9-004e-4439-b475-9537ec7f2a81" containerID="b902e5aae42812014e16a45bebd4aa1cadff12a9988727cedadeeff7f5d73842" exitCode=0
Sep 11 12:44:11.644387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:11.644313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn" event={"ID":"35ca78d9-004e-4439-b475-9537ec7f2a81","Type":"ContainerDied","Data":"b902e5aae42812014e16a45bebd4aa1cadff12a9988727cedadeeff7f5d73842"}
Sep 11 12:44:11.644387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:11.644371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn" event={"ID":"35ca78d9-004e-4439-b475-9537ec7f2a81","Type":"ContainerStarted","Data":"f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538"}
Sep 11 12:44:12.782973 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:12.782945    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:12.881684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:12.881658    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca\") pod \"35ca78d9-004e-4439-b475-9537ec7f2a81\" (UID: \"35ca78d9-004e-4439-b475-9537ec7f2a81\") "
Sep 11 12:44:12.881987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:12.881965    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35ca78d9-004e-4439-b475-9537ec7f2a81" (UID: "35ca78d9-004e-4439-b475-9537ec7f2a81"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:44:12.983154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:12.983134    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ca78d9-004e-4439-b475-9537ec7f2a81-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:13.656902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:13.656867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn" event={"ID":"35ca78d9-004e-4439-b475-9537ec7f2a81","Type":"ContainerDied","Data":"f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538"}
Sep 11 12:44:13.656902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:13.656898    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"
Sep 11 12:44:13.657125 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:13.656913    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6081d20fdd99b24fe17954ed2a74a04556d2b3faf6334925250e509974e3538"
Sep 11 12:44:16.885799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:16.885755    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:17.620267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:17.620231    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:20.839135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:20.839095    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:20.901264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:20.901227    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:20.970539 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:20.970497    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:21.028451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:21.028423    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"]
Sep 11 12:44:21.032097 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:21.032075    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b8dbb2-prsfn"]
Sep 11 12:44:21.036730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:21.036704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:21.370149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:21.370111    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:21.876752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:21.876718    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ca78d9-004e-4439-b475-9537ec7f2a81" path="/var/lib/kubelet/pods/35ca78d9-004e-4439-b475-9537ec7f2a81/volumes"
Sep 11 12:44:23.450756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:23.450720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:23.512683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:23.512653    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:23.601090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:23.601060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:23.700888 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:23.700818    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:23.802915 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:23.802890    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:24.211807 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:24.211777    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:44:24.311407 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:24.311370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:24.414544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:24.414518    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:24.511084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:24.511054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:25.140007 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.139963    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" podUID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" containerName="main" containerID="cri-o://bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102" gracePeriod=45
Sep 11 12:44:25.387688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.387665    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:25.488117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488095    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4dws\" (UniqueName: \"kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488166    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488215    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488249    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488493 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488311    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm\") pod \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\" (UID: \"cbb26e3d-dd41-4253-9e31-1572bb33b80d\") "
Sep 11 12:44:25.488493 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488454    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:25.488592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488472    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home" (OuterVolumeSpecName: "home") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:25.488642 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488597    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:25.488695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488682    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-home\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.488760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488718    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tmp-dir\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.488760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.488734    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-model-cache\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.490396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.490370    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:44:25.490396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.490379    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm" (OuterVolumeSpecName: "dshm") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:25.490534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.490447    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws" (OuterVolumeSpecName: "kube-api-access-h4dws") pod "cbb26e3d-dd41-4253-9e31-1572bb33b80d" (UID: "cbb26e3d-dd41-4253-9e31-1572bb33b80d"). InnerVolumeSpecName "kube-api-access-h4dws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:44:25.589116 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.589095    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4dws\" (UniqueName: \"kubernetes.io/projected/cbb26e3d-dd41-4253-9e31-1572bb33b80d-kube-api-access-h4dws\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.589116 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.589115    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb26e3d-dd41-4253-9e31-1572bb33b80d-tls-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.589425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.589125    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb26e3d-dd41-4253-9e31-1572bb33b80d-dshm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:25.721998 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.721970    2584 generic.go:356] "Generic (PLEG): container finished" podID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" containerID="bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102" exitCode=0
Sep 11 12:44:25.722144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.722006    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"
Sep 11 12:44:25.722144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.722062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" event={"ID":"cbb26e3d-dd41-4253-9e31-1572bb33b80d","Type":"ContainerDied","Data":"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"}
Sep 11 12:44:25.722144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.722102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn" event={"ID":"cbb26e3d-dd41-4253-9e31-1572bb33b80d","Type":"ContainerDied","Data":"6bbef3634657b53eb7c8e01fd3c76b2da635f63c01c931409f1831abda6268ba"}
Sep 11 12:44:25.722144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.722122    2584 scope.go:117] "RemoveContainer" containerID="bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"
Sep 11 12:44:25.732589 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.732571    2584 scope.go:117] "RemoveContainer" containerID="bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"
Sep 11 12:44:25.732885 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:44:25.732866    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102\": container with ID starting with bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102 not found: ID does not exist" containerID="bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"
Sep 11 12:44:25.732948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.732892    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102"} err="failed to get container status \"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102\": rpc error: code = NotFound desc = could not find container \"bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102\": container with ID starting with bfa26be22a77ef8978d319c8a8c3efcda0f1d2ba2ffe082d5d80f0b4c4cbb102 not found: ID does not exist"
Sep 11 12:44:25.745273 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.745222    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:44:25.749311 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.749291    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-b8dbb2/explicit-model-b8dbb2-kserve-784cf8b4f7-7qdwn"]
Sep 11 12:44:25.877070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.877047    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" path="/var/lib/kubelet/pods/cbb26e3d-dd41-4253-9e31-1572bb33b80d/volumes"
Sep 11 12:44:25.939152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:25.939124    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:27.612275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:27.612236    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:27.712155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:27.712123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:27.847155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:27.847127    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:44:27.847341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:27.847317    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy" containerID="cri-o://c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04" gracePeriod=30
Sep 11 12:44:27.886434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:27.886346    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:28.281005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.280963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:28.543497 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543423    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:44:28.543814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543802    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35ca78d9-004e-4439-b475-9537ec7f2a81" containerName="revoke-keys"
Sep 11 12:44:28.543857 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543816    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35ca78d9-004e-4439-b475-9537ec7f2a81" containerName="revoke-keys"
Sep 11 12:44:28.543857 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543828    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" containerName="main"
Sep 11 12:44:28.543857 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543834    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" containerName="main"
Sep 11 12:44:28.543952 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543894    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbb26e3d-dd41-4253-9e31-1572bb33b80d" containerName="main"
Sep 11 12:44:28.543952 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.543905    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35ca78d9-004e-4439-b475-9537ec7f2a81" containerName="revoke-keys"
Sep 11 12:44:28.548556 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.548531    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.551278 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.551256    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-30295a-openshift-default-dockercfg-pdskm\""
Sep 11 12:44:28.558272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.558250    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:44:28.573497 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.573458    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:28.674442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.674414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:28.714277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714558 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714558 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714558 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714539    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714569    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57pt\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.714777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.714738    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.815936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.815936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.815936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.815936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815957    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.815980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57pt\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816380    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.816817 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.816795    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.818148 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.818132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.818670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.818653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.824928 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.824906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.825330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.825311    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57pt\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt\") pod \"e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") " pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:28.859233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:28.859215    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:29.156576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.156544    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:44:29.157080 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:44:29.157055    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1aa0d62_9388_4e03_90a2_e86da26b68ea.slice/crio-68018a4fef995ae99d3c81246bf56a72c97f979dfa9db7747e271dfbb157fd50 WatchSource:0}: Error finding container 68018a4fef995ae99d3c81246bf56a72c97f979dfa9db7747e271dfbb157fd50: Status 404 returned error can't find the container with id 68018a4fef995ae99d3c81246bf56a72c97f979dfa9db7747e271dfbb157fd50
Sep 11 12:44:29.159223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.159189    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:29.159323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.159254    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:29.159323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.159291    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:29.748862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.748824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" event={"ID":"d1aa0d62-9388-4e03-90a2-e86da26b68ea","Type":"ContainerStarted","Data":"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"}
Sep 11 12:44:29.749243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.748891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" event={"ID":"d1aa0d62-9388-4e03-90a2-e86da26b68ea","Type":"ContainerStarted","Data":"68018a4fef995ae99d3c81246bf56a72c97f979dfa9db7747e271dfbb157fd50"}
Sep 11 12:44:29.774021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.773972    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" podStartSLOduration=1.7739588240000002 podStartE2EDuration="1.773958824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:44:29.771842325 +0000 UTC m=+1062.415734976" watchObservedRunningTime="2026-09-11 12:44:29.773958824 +0000 UTC m=+1062.417851481"
Sep 11 12:44:29.859335 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:29.859305    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:30.050261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:30.050171    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:30.146664 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:30.146629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:30.250881 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:30.250835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:30.864175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:30.864144    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:31.760879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:31.760849    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:31.761898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:31.761870    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:44:32.097693 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:32.097603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:32.196002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:32.195970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:32.754221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:32.754186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:33.088332 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.088303    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:44:33.260552 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260472    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.260552 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260526    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ls2k\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260584    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260613    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260666    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260705    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260731    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260746    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260839    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260838    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data" (OuterVolumeSpecName: "istio-data") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260868    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket\") pod \"063a255a-a3f8-4214-87ed-40c0234a9245\" (UID: \"063a255a-a3f8-4214-87ed-40c0234a9245\") "
Sep 11 12:44:33.261070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.260997    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:33.261605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.261164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:33.261605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.261189    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.261605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.261226    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.261605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.261230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:44:33.261605 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.261240    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.262784 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.262762    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k" (OuterVolumeSpecName: "kube-api-access-4ls2k") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "kube-api-access-4ls2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:44:33.262910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.262897    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token" (OuterVolumeSpecName: "istio-token") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:44:33.263181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.263165    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:44:33.263261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.263178    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "063a255a-a3f8-4214-87ed-40c0234a9245" (UID: "063a255a-a3f8-4214-87ed-40c0234a9245"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:44:33.361757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361721    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.361757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361751    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/063a255a-a3f8-4214-87ed-40c0234a9245-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.361946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361764    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/063a255a-a3f8-4214-87ed-40c0234a9245-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.361946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361776    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/063a255a-a3f8-4214-87ed-40c0234a9245-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.361946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361789    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ls2k\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-kube-api-access-4ls2k\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.361946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.361799    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/063a255a-a3f8-4214-87ed-40c0234a9245-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:44:33.784901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.784861    2584 generic.go:356] "Generic (PLEG): container finished" podID="063a255a-a3f8-4214-87ed-40c0234a9245" containerID="c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04" exitCode=0
Sep 11 12:44:33.785098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.784911    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"
Sep 11 12:44:33.785098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.784950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerDied","Data":"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"}
Sep 11 12:44:33.785098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.785067    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv" event={"ID":"063a255a-a3f8-4214-87ed-40c0234a9245","Type":"ContainerDied","Data":"29b8c40485ee7697de79b18c9878eddfa69c9de6b22ca4997f565ae19fe7a2e7"}
Sep 11 12:44:33.785307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.785103    2584 scope.go:117] "RemoveContainer" containerID="c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"
Sep 11 12:44:33.796698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.796681    2584 scope.go:117] "RemoveContainer" containerID="9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"
Sep 11 12:44:33.805059 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.805019    2584 scope.go:117] "RemoveContainer" containerID="c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"
Sep 11 12:44:33.805299 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:44:33.805282    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04\": container with ID starting with c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04 not found: ID does not exist" containerID="c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"
Sep 11 12:44:33.805364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.805304    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04"} err="failed to get container status \"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04\": rpc error: code = NotFound desc = could not find container \"c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04\": container with ID starting with c6178daa7676e742fac370d93696b831a514e10e4446297edff1c6dd58e94e04 not found: ID does not exist"
Sep 11 12:44:33.805364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.805318    2584 scope.go:117] "RemoveContainer" containerID="9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"
Sep 11 12:44:33.805552 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:44:33.805536    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c\": container with ID starting with 9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c not found: ID does not exist" containerID="9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"
Sep 11 12:44:33.805587 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.805555    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c"} err="failed to get container status \"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c\": rpc error: code = NotFound desc = could not find container \"9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c\": container with ID starting with 9fccdeebd49478fd1ce633e2ae8a74a6d9042c475b8dada055668c1dd7a3602c not found: ID does not exist"
Sep 11 12:44:33.810591 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.810574    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:44:33.815784 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.815762    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-b8dbb2-openshift-default-77c68d58b8-gmqxv"]
Sep 11 12:44:33.877001 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:33.876974    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" path="/var/lib/kubelet/pods/063a255a-a3f8-4214-87ed-40c0234a9245/volumes"
Sep 11 12:44:35.236456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:35.236422    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:35.286514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:35.286470    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:38.491302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.491261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:38.646240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.646213    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:38.746713 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.746634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:38.949401 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.949369    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:44:38.949889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.949855    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.949889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.949888    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.950131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.949920    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.950131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.949928    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.950131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.950059    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.950131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.950075    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="063a255a-a3f8-4214-87ed-40c0234a9245" containerName="istio-proxy"
Sep 11 12:44:38.954623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.954601    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:38.957169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.957148    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-54e055b6-openshift-default-dockercfg-nxr8x\""
Sep 11 12:44:38.966614 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.966589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:44:38.986701 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:38.986657    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:39.112071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.111972    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112013    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112187    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f82sk\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112234    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112265    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.112408 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.112319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213428 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f82sk\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213443    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213843    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.213980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.213896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.214085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.214071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.214133 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.214114    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.214402 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.214384    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.216248 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.216224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.216434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.216416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.221244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.221216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.221771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.221749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f82sk\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk\") pod \"e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") " pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.266322 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.266299    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:39.540262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.540226    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:39.541734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.541713    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:44:39.543265 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:44:39.543241    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8527bd86_1519_40b8_aa7d_c4c0ad5a41b2.slice/crio-36c7d949e5a8b437fc1c487458aa425ddfd1a2175ab36f5dcae2dedd1dbe7d47 WatchSource:0}: Error finding container 36c7d949e5a8b437fc1c487458aa425ddfd1a2175ab36f5dcae2dedd1dbe7d47: Status 404 returned error can't find the container with id 36c7d949e5a8b437fc1c487458aa425ddfd1a2175ab36f5dcae2dedd1dbe7d47
Sep 11 12:44:39.545353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.545326    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:39.545428 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.545388    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:39.545428 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.545415    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:39.822076 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.821971    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerStarted","Data":"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"}
Sep 11 12:44:39.822076 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.822021    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerStarted","Data":"36c7d949e5a8b437fc1c487458aa425ddfd1a2175ab36f5dcae2dedd1dbe7d47"}
Sep 11 12:44:39.846082 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:39.846010    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podStartSLOduration=1.845990353 podStartE2EDuration="1.845990353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:44:39.843716129 +0000 UTC m=+1072.487608788" watchObservedRunningTime="2026-09-11 12:44:39.845990353 +0000 UTC m=+1072.489883010"
Sep 11 12:44:40.266890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:40.266858    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:40.271714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:40.271691    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:40.830161 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:40.830128    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:40.831150 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:40.831129    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:41.738954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:41.738915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:41.837148 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:41.837108    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:42.877889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:42.877854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:42.939808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:42.939777    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:43.049333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:43.049297    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:43.368537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:43.368500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:43.442391 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:43.442363    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:44:46.487181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:46.487151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:44:55.975615 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:55.975036    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:33996->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Sep 11 12:44:55.975615 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:55.975096    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:33996->10.133.0.72:15021: read: connection reset by peer"
Sep 11 12:44:56.930312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.930273    2584 generic.go:356] "Generic (PLEG): container finished" podID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerID="b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217" exitCode=0
Sep 11 12:44:56.930312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.930301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerDied","Data":"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"}
Sep 11 12:44:56.930681 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.930666    2584 scope.go:117] "RemoveContainer" containerID="b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"
Sep 11 12:44:56.931838 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.931810    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:56.931916 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.931880    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:56.931916 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:56.931912    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:44:57.941656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:57.941615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerStarted","Data":"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"}
Sep 11 12:44:58.267212 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:58.267176    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:44:58.267454 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:58.267428    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:44:58.267549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:58.267502    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 12:44:59.267359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:59.267327    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:44:59.267814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:44:59.267378    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 12:45:00.142110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.142073    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"]
Sep 11 12:45:00.146502 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.146476    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"]
Sep 11 12:45:00.149780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.149749    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"
Sep 11 12:45:00.150474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.150454    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"]
Sep 11 12:45:00.150686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.150670    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"
Sep 11 12:45:00.154887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.154869    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:45:00.155732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.155709    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"]
Sep 11 12:45:00.167525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.167504    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"
Sep 11 12:45:00.173356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.173336    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"
Sep 11 12:45:00.268677 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.268645    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:45:00.269108 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.268704    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 12:45:00.479774 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.479746    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"]
Sep 11 12:45:00.481398 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:00.481370    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b0435f_b41f_4292_a280_2c535e465b12.slice/crio-3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0 WatchSource:0}: Error finding container 3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0: Status 404 returned error can't find the container with id 3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0
Sep 11 12:45:00.502745 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.502722    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"]
Sep 11 12:45:00.504575 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:00.504548    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556d4fc8_c72a_42fa_884f_bdcb7936f0d5.slice/crio-c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63 WatchSource:0}: Error finding container c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63: Status 404 returned error can't find the container with id c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63
Sep 11 12:45:00.965020 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.964984    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c" event={"ID":"556d4fc8-c72a-42fa-884f-bdcb7936f0d5","Type":"ContainerStarted","Data":"191a10b8e5e1041a960006736b8c45ba4ce4fd2f2b50a27b24ebca5587c47ef8"}
Sep 11 12:45:00.965230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.965054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c" event={"ID":"556d4fc8-c72a-42fa-884f-bdcb7936f0d5","Type":"ContainerStarted","Data":"c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63"}
Sep 11 12:45:00.966532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.966505    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr" event={"ID":"61b0435f-b41f-4292-a280-2c535e465b12","Type":"ContainerStarted","Data":"f12e7688774e060e41983650ced8348fa5df4ff291923863f04ad3e01be87708"}
Sep 11 12:45:00.966653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.966546    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr" event={"ID":"61b0435f-b41f-4292-a280-2c535e465b12","Type":"ContainerStarted","Data":"3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0"}
Sep 11 12:45:00.980719 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.980681    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c" podStartSLOduration=0.980668568 podStartE2EDuration="980.668568ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:00.978152087 +0000 UTC m=+1093.622044742" watchObservedRunningTime="2026-09-11 12:45:00.980668568 +0000 UTC m=+1093.624561223"
Sep 11 12:45:00.993426 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:00.993354    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr" podStartSLOduration=0.993341075 podStartE2EDuration="993.341075ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:00.992213305 +0000 UTC m=+1093.636105961" watchObservedRunningTime="2026-09-11 12:45:00.993341075 +0000 UTC m=+1093.637233775"
Sep 11 12:45:01.267782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.267704    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:45:01.267782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.267757    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 12:45:01.973540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.973456    2584 generic.go:356] "Generic (PLEG): container finished" podID="61b0435f-b41f-4292-a280-2c535e465b12" containerID="f12e7688774e060e41983650ced8348fa5df4ff291923863f04ad3e01be87708" exitCode=0
Sep 11 12:45:01.973918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.973534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr" event={"ID":"61b0435f-b41f-4292-a280-2c535e465b12","Type":"ContainerDied","Data":"f12e7688774e060e41983650ced8348fa5df4ff291923863f04ad3e01be87708"}
Sep 11 12:45:01.975146 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.975125    2584 generic.go:356] "Generic (PLEG): container finished" podID="556d4fc8-c72a-42fa-884f-bdcb7936f0d5" containerID="191a10b8e5e1041a960006736b8c45ba4ce4fd2f2b50a27b24ebca5587c47ef8" exitCode=0
Sep 11 12:45:01.975254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:01.975158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c" event={"ID":"556d4fc8-c72a-42fa-884f-bdcb7936f0d5","Type":"ContainerDied","Data":"191a10b8e5e1041a960006736b8c45ba4ce4fd2f2b50a27b24ebca5587c47ef8"}
Sep 11 12:45:02.266649 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:02.266611    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:45:02.266812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:02.266677    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 12:45:03.097822 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.097791    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:03.101248 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.101229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.105380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.105349    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-30295a\"/\"openshift-service-ca.crt\""
Sep 11 12:45:03.105559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.105388    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-30295a\"/\"kube-root-ca.crt\""
Sep 11 12:45:03.105559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.105464    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-30295a\"/\"default-dockercfg-cg4zn\""
Sep 11 12:45:03.105685 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.105634    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-30295a\"/\"noten-model-30295a-kserve-self-signed-certs\""
Sep 11 12:45:03.111335 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.111311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:03.120089 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.120022    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:03.139043 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.139010    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"
Sep 11 12:45:03.179415 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.179390    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"
Sep 11 12:45:03.234366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234332    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.234545 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234370    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqgcj\" (UniqueName: \"kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.234612 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.234612 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.234735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.234735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.234685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.272286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.272260    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:45:03.272628 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.272601    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:45:03.273473 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.273453    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:45:03.336203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqgcj\" (UniqueName: \"kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336598 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.336980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.336734    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.337346 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.337147    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.339709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.339682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.340090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.340072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.344239 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.344218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqgcj\" (UniqueName: \"kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj\") pod \"noten-model-30295a-kserve-78d4f87d87-qcdhx\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") " pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.434476 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.434440    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:03.702769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.702733    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:03.703633 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:03.703605    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43d46d6b_bc17_4a05_ab20_2c2807881606.slice/crio-f232f42ea1167f563eaebca4eb05aed844f1046951eb5775305122f8fbc5001f WatchSource:0}: Error finding container f232f42ea1167f563eaebca4eb05aed844f1046951eb5775305122f8fbc5001f: Status 404 returned error can't find the container with id f232f42ea1167f563eaebca4eb05aed844f1046951eb5775305122f8fbc5001f
Sep 11 12:45:03.988226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.988203    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr"
Sep 11 12:45:03.988358 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.988241    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818845-c6mqr" event={"ID":"61b0435f-b41f-4292-a280-2c535e465b12","Type":"ContainerDied","Data":"3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0"}
Sep 11 12:45:03.988358 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.988290    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a5f8dbb67c61db458beda9f861fd994b213e09da6412c963fd6759baaa64ac0"
Sep 11 12:45:03.989624 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.989605    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"
Sep 11 12:45:03.989762 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.989605    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c" event={"ID":"556d4fc8-c72a-42fa-884f-bdcb7936f0d5","Type":"ContainerDied","Data":"c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63"}
Sep 11 12:45:03.989762 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.989712    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3357b1e1760b500d7d00b830a9304add340958ef5bfbe6512cf7e593cdf6b63"
Sep 11 12:45:03.991472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.991382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" event={"ID":"43d46d6b-bc17-4a05-ab20-2c2807881606","Type":"ContainerStarted","Data":"7e1bcfea6b9474fa69306d327b9003c92a62b262b2f722631f6493501083ad2f"}
Sep 11 12:45:03.991472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:03.991418    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" event={"ID":"43d46d6b-bc17-4a05-ab20-2c2807881606","Type":"ContainerStarted","Data":"f232f42ea1167f563eaebca4eb05aed844f1046951eb5775305122f8fbc5001f"}
Sep 11 12:45:04.009692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:04.009651    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" podStartSLOduration=1.009639691 podStartE2EDuration="1.009639691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:04.006749253 +0000 UTC m=+1096.650641910" watchObservedRunningTime="2026-09-11 12:45:04.009639691 +0000 UTC m=+1096.653532347"
Sep 11 12:45:05.121931 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:05.121894    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:06.688488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:06.688452    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:07.328073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:07.328016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:07.428838 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:07.428806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:07.796331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:07.796296    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:08.958821 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:08.958787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:08.977792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:08.977766    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:45:09.050213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050183    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"]
Sep 11 12:45:09.050709 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050691    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b0435f-b41f-4292-a280-2c535e465b12" containerName="cleanup"
Sep 11 12:45:09.050763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050711    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b0435f-b41f-4292-a280-2c535e465b12" containerName="cleanup"
Sep 11 12:45:09.050763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050739    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556d4fc8-c72a-42fa-884f-bdcb7936f0d5" containerName="cleanup"
Sep 11 12:45:09.050763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050745    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="556d4fc8-c72a-42fa-884f-bdcb7936f0d5" containerName="cleanup"
Sep 11 12:45:09.050866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050807    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="556d4fc8-c72a-42fa-884f-bdcb7936f0d5" containerName="cleanup"
Sep 11 12:45:09.050866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.050816    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b0435f-b41f-4292-a280-2c535e465b12" containerName="cleanup"
Sep 11 12:45:09.060669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.060645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:09.062549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.062524    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"]
Sep 11 12:45:09.063729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.063708    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:45:09.063858 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.063846    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:45:09.188992 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.188963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj\" (UID: \"429cd8fa-51bb-4311-8715-04de1681582d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:09.209287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.209218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:09.289723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.289698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj\" (UID: \"429cd8fa-51bb-4311-8715-04de1681582d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:09.290353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.290328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj\" (UID: \"429cd8fa-51bb-4311-8715-04de1681582d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:09.374503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.374470    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:09.648487 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.648460    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"]
Sep 11 12:45:09.649186 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:09.649156    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429cd8fa_51bb_4311_8715_04de1681582d.slice/crio-e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212 WatchSource:0}: Error finding container e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212: Status 404 returned error can't find the container with id e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212
Sep 11 12:45:09.990070 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:09.987546    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:10.001867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.001833    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:10.033342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.033302    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj" event={"ID":"429cd8fa-51bb-4311-8715-04de1681582d","Type":"ContainerStarted","Data":"fe235cb1596ffa9f6e3bd8676001ffede3949e1bc5f9e440159f6753c02f8211"}
Sep 11 12:45:10.033523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.033371    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj" event={"ID":"429cd8fa-51bb-4311-8715-04de1681582d","Type":"ContainerStarted","Data":"e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212"}
Sep 11 12:45:10.053499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.053442    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj" podStartSLOduration=1.053420387 podStartE2EDuration="1.053420387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:10.049475257 +0000 UTC m=+1102.693367916" watchObservedRunningTime="2026-09-11 12:45:10.053420387 +0000 UTC m=+1102.697313054"
Sep 11 12:45:10.094734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.094689    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:45:10.094962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.094911    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" podUID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" containerName="istio-proxy" containerID="cri-o://ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab" gracePeriod=30
Sep 11 12:45:10.110590 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.110546    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:10.317340 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.317307    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:10.430225 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:10.430192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:11.041167 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:11.041133    2584 generic.go:356] "Generic (PLEG): container finished" podID="429cd8fa-51bb-4311-8715-04de1681582d" containerID="fe235cb1596ffa9f6e3bd8676001ffede3949e1bc5f9e440159f6753c02f8211" exitCode=0
Sep 11 12:45:11.041525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:11.041217    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj" event={"ID":"429cd8fa-51bb-4311-8715-04de1681582d","Type":"ContainerDied","Data":"fe235cb1596ffa9f6e3bd8676001ffede3949e1bc5f9e440159f6753c02f8211"}
Sep 11 12:45:12.181252 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:12.181230    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:12.316237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:12.316172    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca\") pod \"429cd8fa-51bb-4311-8715-04de1681582d\" (UID: \"429cd8fa-51bb-4311-8715-04de1681582d\") "
Sep 11 12:45:12.316548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:12.316527    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "429cd8fa-51bb-4311-8715-04de1681582d" (UID: "429cd8fa-51bb-4311-8715-04de1681582d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:12.417452 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:12.417422    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/429cd8fa-51bb-4311-8715-04de1681582d-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:13.053621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.053591    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"
Sep 11 12:45:13.053621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.053596    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj" event={"ID":"429cd8fa-51bb-4311-8715-04de1681582d","Type":"ContainerDied","Data":"e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212"}
Sep 11 12:45:13.053883 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.053639    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1103a50bb71439f988cfbc010641d6c36b5eafb96104390e14658625cf14212"
Sep 11 12:45:13.425623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.425516    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:13.435313 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.435288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:13.526311 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.526290    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:13.708880 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.708811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:13.779799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:13.779775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:14.074484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.074459    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"]
Sep 11 12:45:14.074836 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.074824    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="429cd8fa-51bb-4311-8715-04de1681582d" containerName="revoke-keys"
Sep 11 12:45:14.074885 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.074837    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="429cd8fa-51bb-4311-8715-04de1681582d" containerName="revoke-keys"
Sep 11 12:45:14.074919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.074895    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="429cd8fa-51bb-4311-8715-04de1681582d" containerName="revoke-keys"
Sep 11 12:45:14.077912 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.077892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:14.080469 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.080450    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:45:14.080575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.080552    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:45:14.087434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.087414    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"]
Sep 11 12:45:14.216749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.216714    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:14.235351 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.235323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs\" (UID: \"1d42131e-2db9-4540-8a23-97fcda5259fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:14.336181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.336092    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs\" (UID: \"1d42131e-2db9-4540-8a23-97fcda5259fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:14.336696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.336678    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs\" (UID: \"1d42131e-2db9-4540-8a23-97fcda5259fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:14.390543 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.390515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:14.660920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:14.660890    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"]
Sep 11 12:45:14.663147 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:14.663121    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d42131e_2db9_4540_8a23_97fcda5259fb.slice/crio-98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1 WatchSource:0}: Error finding container 98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1: Status 404 returned error can't find the container with id 98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1
Sep 11 12:45:15.066350 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.066313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs" event={"ID":"1d42131e-2db9-4540-8a23-97fcda5259fb","Type":"ContainerStarted","Data":"e94736550961eefcd7b50622d15741edc301c2b5f8f53847ab1213d8ac0483eb"}
Sep 11 12:45:15.066499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.066376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs" event={"ID":"1d42131e-2db9-4540-8a23-97fcda5259fb","Type":"ContainerStarted","Data":"98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1"}
Sep 11 12:45:15.082350 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.082310    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs" podStartSLOduration=1.082296361 podStartE2EDuration="1.082296361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:15.081355627 +0000 UTC m=+1107.725248283" watchObservedRunningTime="2026-09-11 12:45:15.082296361 +0000 UTC m=+1107.726189017"
Sep 11 12:45:15.333476 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.333442    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:45:15.447087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447063    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447118    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447175    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447201    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447235    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447266    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z57pt\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447294    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:15.447352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447353    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447377    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy\") pod \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\" (UID: \"d1aa0d62-9388-4e03-90a2-e86da26b68ea\") "
Sep 11 12:45:15.447506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:15.447506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447448    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:15.447707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:15.447707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447651    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:15.447813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447713    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.447813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447728    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.447813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447737    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.447813 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.447746    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.449378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.449327    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:45:15.449470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.449416    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:15.449470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.449425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:15.449470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.449435    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt" (OuterVolumeSpecName: "kube-api-access-z57pt") pod "d1aa0d62-9388-4e03-90a2-e86da26b68ea" (UID: "d1aa0d62-9388-4e03-90a2-e86da26b68ea"). InnerVolumeSpecName "kube-api-access-z57pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:15.457434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.457407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:15.548316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.548297    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.548316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.548317    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.548446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.548325    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.548446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.548333    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:15.548446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:15.548340    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z57pt\" (UniqueName: \"kubernetes.io/projected/d1aa0d62-9388-4e03-90a2-e86da26b68ea-kube-api-access-z57pt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:16.073979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.073944    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d42131e-2db9-4540-8a23-97fcda5259fb" containerID="e94736550961eefcd7b50622d15741edc301c2b5f8f53847ab1213d8ac0483eb" exitCode=0
Sep 11 12:45:16.074355 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.074021    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs" event={"ID":"1d42131e-2db9-4540-8a23-97fcda5259fb","Type":"ContainerDied","Data":"e94736550961eefcd7b50622d15741edc301c2b5f8f53847ab1213d8ac0483eb"}
Sep 11 12:45:16.075450 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.075428    2584 generic.go:356] "Generic (PLEG): container finished" podID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" containerID="ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab" exitCode=0
Sep 11 12:45:16.075544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.075479    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"
Sep 11 12:45:16.075544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.075498    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" event={"ID":"d1aa0d62-9388-4e03-90a2-e86da26b68ea","Type":"ContainerDied","Data":"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"}
Sep 11 12:45:16.075544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.075535    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb" event={"ID":"d1aa0d62-9388-4e03-90a2-e86da26b68ea","Type":"ContainerDied","Data":"68018a4fef995ae99d3c81246bf56a72c97f979dfa9db7747e271dfbb157fd50"}
Sep 11 12:45:16.075656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.075559    2584 scope.go:117] "RemoveContainer" containerID="ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"
Sep 11 12:45:16.086769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.086750    2584 scope.go:117] "RemoveContainer" containerID="ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"
Sep 11 12:45:16.087210 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:16.087175    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab\": container with ID starting with ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab not found: ID does not exist" containerID="ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"
Sep 11 12:45:16.087294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.087220    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab"} err="failed to get container status \"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab\": rpc error: code = NotFound desc = could not find container \"ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab\": container with ID starting with ab40806ae4adebce89024fc7e238c7f854ee11546817db198020e16cb1efbbab not found: ID does not exist"
Sep 11 12:45:16.102900 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.102869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:45:16.107977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:16.107952    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-30295a-openshift-default-56fd8ddcb8-4mjrb"]
Sep 11 12:45:17.204209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:17.204187    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:17.361576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:17.361496    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca\") pod \"1d42131e-2db9-4540-8a23-97fcda5259fb\" (UID: \"1d42131e-2db9-4540-8a23-97fcda5259fb\") "
Sep 11 12:45:17.361839 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:17.361817    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1d42131e-2db9-4540-8a23-97fcda5259fb" (UID: "1d42131e-2db9-4540-8a23-97fcda5259fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:17.462967 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:17.462939    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d42131e-2db9-4540-8a23-97fcda5259fb-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:17.876866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:17.876825    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" path="/var/lib/kubelet/pods/d1aa0d62-9388-4e03-90a2-e86da26b68ea/volumes"
Sep 11 12:45:18.088865 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:18.088841    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"
Sep 11 12:45:18.089067 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:18.088839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs" event={"ID":"1d42131e-2db9-4540-8a23-97fcda5259fb","Type":"ContainerDied","Data":"98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1"}
Sep 11 12:45:18.089067 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:18.088964    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98466b525a896e8940298ab32f6ebd26d47fbe218dd110086b279cd232e0e3d1"
Sep 11 12:45:19.334477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:19.334444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:19.881198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:19.881165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:19.942682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:19.942644    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:20.042743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.042712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:20.054472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.054447    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"]
Sep 11 12:45:20.056806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.056786    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edce0b-xjjmj"]
Sep 11 12:45:20.144400 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.144306    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:20.399934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.399853    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:20.480096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:20.480062    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:45:21.876685 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:21.876648    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="429cd8fa-51bb-4311-8715-04de1681582d" path="/var/lib/kubelet/pods/429cd8fa-51bb-4311-8715-04de1681582d/volumes"
Sep 11 12:45:24.198501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.198464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:24.765187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.765152    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:24.767186 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.767161    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"]
Sep 11 12:45:24.769644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.769615    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54e055b6-29818845-ltn5c"]
Sep 11 12:45:24.829795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.829767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:24.890891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.890861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:24.946528 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.946494    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"]
Sep 11 12:45:24.948751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.948724    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54e055b6-qb4hs"]
Sep 11 12:45:24.954747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:24.954716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:25.012322 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.012292    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" podUID="43d46d6b-bc17-4a05-ab20-2c2807881606" containerName="main" containerID="cri-o://7e1bcfea6b9474fa69306d327b9003c92a62b262b2f722631f6493501083ad2f" gracePeriod=45
Sep 11 12:45:25.139828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.139801    2584 generic.go:356] "Generic (PLEG): container finished" podID="43d46d6b-bc17-4a05-ab20-2c2807881606" containerID="7e1bcfea6b9474fa69306d327b9003c92a62b262b2f722631f6493501083ad2f" exitCode=0
Sep 11 12:45:25.139935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.139843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" event={"ID":"43d46d6b-bc17-4a05-ab20-2c2807881606","Type":"ContainerDied","Data":"7e1bcfea6b9474fa69306d327b9003c92a62b262b2f722631f6493501083ad2f"}
Sep 11 12:45:25.267698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.267638    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:25.306509 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.306479    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:25.432867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.432836    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.432983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.432892    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.432983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.432925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.432983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.432955    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqgcj\" (UniqueName: \"kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.433163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433018    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.433163 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm\") pod \"43d46d6b-bc17-4a05-ab20-2c2807881606\" (UID: \"43d46d6b-bc17-4a05-ab20-2c2807881606\") "
Sep 11 12:45:25.433298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433238    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache" (OuterVolumeSpecName: "model-cache") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:25.433298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433247    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:25.433298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433282    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home" (OuterVolumeSpecName: "home") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:25.433475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433443    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-home\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.433475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433464    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-model-cache\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.433583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.433478    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-tmp-dir\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.435198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.435177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:25.435275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.435181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm" (OuterVolumeSpecName: "dshm") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:25.435275 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.435267    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj" (OuterVolumeSpecName: "kube-api-access-pqgcj") pod "43d46d6b-bc17-4a05-ab20-2c2807881606" (UID: "43d46d6b-bc17-4a05-ab20-2c2807881606"). InnerVolumeSpecName "kube-api-access-pqgcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:25.533901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.533835    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d46d6b-bc17-4a05-ab20-2c2807881606-dshm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.533901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.533857    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d46d6b-bc17-4a05-ab20-2c2807881606-tls-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.533901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.533867    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqgcj\" (UniqueName: \"kubernetes.io/projected/43d46d6b-bc17-4a05-ab20-2c2807881606-kube-api-access-pqgcj\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.884273 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.884183    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d42131e-2db9-4540-8a23-97fcda5259fb" path="/var/lib/kubelet/pods/1d42131e-2db9-4540-8a23-97fcda5259fb/volumes"
Sep 11 12:45:25.884562 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:25.884541    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556d4fc8-c72a-42fa-884f-bdcb7936f0d5" path="/var/lib/kubelet/pods/556d4fc8-c72a-42fa-884f-bdcb7936f0d5/volumes"
Sep 11 12:45:26.147242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.147158    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx" event={"ID":"43d46d6b-bc17-4a05-ab20-2c2807881606","Type":"ContainerDied","Data":"f232f42ea1167f563eaebca4eb05aed844f1046951eb5775305122f8fbc5001f"}
Sep 11 12:45:26.147242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.147196    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"
Sep 11 12:45:26.147242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.147207    2584 scope.go:117] "RemoveContainer" containerID="7e1bcfea6b9474fa69306d327b9003c92a62b262b2f722631f6493501083ad2f"
Sep 11 12:45:26.165604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.165571    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:26.172229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.172206    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-30295a/noten-model-30295a-kserve-78d4f87d87-qcdhx"]
Sep 11 12:45:26.408837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.408759    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:26.508182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.508147    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:26.647446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.647415    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:45:26.647683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.647658    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy" containerID="cri-o://2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc" gracePeriod=30
Sep 11 12:45:26.676618 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:26.676527    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:27.003735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.003705    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"]
Sep 11 12:45:27.004077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004064    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d42131e-2db9-4540-8a23-97fcda5259fb" containerName="revoke-keys"
Sep 11 12:45:27.004135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004079    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d42131e-2db9-4540-8a23-97fcda5259fb" containerName="revoke-keys"
Sep 11 12:45:27.004135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004094    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d46d6b-bc17-4a05-ab20-2c2807881606" containerName="main"
Sep 11 12:45:27.004135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004100    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d46d6b-bc17-4a05-ab20-2c2807881606" containerName="main"
Sep 11 12:45:27.004135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004114    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" containerName="istio-proxy"
Sep 11 12:45:27.004135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004119    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" containerName="istio-proxy"
Sep 11 12:45:27.004300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004175    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d42131e-2db9-4540-8a23-97fcda5259fb" containerName="revoke-keys"
Sep 11 12:45:27.004300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004186    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1aa0d62-9388-4e03-90a2-e86da26b68ea" containerName="istio-proxy"
Sep 11 12:45:27.004300 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.004193    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="43d46d6b-bc17-4a05-ab20-2c2807881606" containerName="main"
Sep 11 12:45:27.008635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.008618    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:27.011080 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.011062    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:45:27.011158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.011066    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:45:27.015591 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.015567    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"]
Sep 11 12:45:27.046913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.046889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr\" (UID: \"9ee0a8ae-c78f-4e23-a37f-24f227aaac26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:27.125729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.125698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:27.147773 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.147746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr\" (UID: \"9ee0a8ae-c78f-4e23-a37f-24f227aaac26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:27.148371 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.148347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr\" (UID: \"9ee0a8ae-c78f-4e23-a37f-24f227aaac26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:27.320457 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.320379    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:27.593702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.593678    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"]
Sep 11 12:45:27.594918 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:27.594893    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee0a8ae_c78f_4e23_a37f_24f227aaac26.slice/crio-cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a WatchSource:0}: Error finding container cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a: Status 404 returned error can't find the container with id cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a
Sep 11 12:45:27.878183 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:27.878125    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43d46d6b-bc17-4a05-ab20-2c2807881606" path="/var/lib/kubelet/pods/43d46d6b-bc17-4a05-ab20-2c2807881606/volumes"
Sep 11 12:45:28.160622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:28.160543    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr" event={"ID":"9ee0a8ae-c78f-4e23-a37f-24f227aaac26","Type":"ContainerStarted","Data":"faf6c5289e7bdd28cf56b820a890e788d3c17abef7408d06c31b57d1c3a2525e"}
Sep 11 12:45:28.160622 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:28.160592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr" event={"ID":"9ee0a8ae-c78f-4e23-a37f-24f227aaac26","Type":"ContainerStarted","Data":"cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a"}
Sep 11 12:45:28.178985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:28.178938    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr" podStartSLOduration=2.178923536 podStartE2EDuration="2.178923536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:28.176995295 +0000 UTC m=+1120.820887953" watchObservedRunningTime="2026-09-11 12:45:28.178923536 +0000 UTC m=+1120.822816192"
Sep 11 12:45:29.168655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:29.168620    2584 generic.go:356] "Generic (PLEG): container finished" podID="9ee0a8ae-c78f-4e23-a37f-24f227aaac26" containerID="faf6c5289e7bdd28cf56b820a890e788d3c17abef7408d06c31b57d1c3a2525e" exitCode=0
Sep 11 12:45:29.169068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:29.168695    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr" event={"ID":"9ee0a8ae-c78f-4e23-a37f-24f227aaac26","Type":"ContainerDied","Data":"faf6c5289e7bdd28cf56b820a890e788d3c17abef7408d06c31b57d1c3a2525e"}
Sep 11 12:45:29.380524 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:29.380493    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:45:30.297445 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:30.297421    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:30.375484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:30.375458    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca\") pod \"9ee0a8ae-c78f-4e23-a37f-24f227aaac26\" (UID: \"9ee0a8ae-c78f-4e23-a37f-24f227aaac26\") "
Sep 11 12:45:30.375856 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:30.375835    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ee0a8ae-c78f-4e23-a37f-24f227aaac26" (UID: "9ee0a8ae-c78f-4e23-a37f-24f227aaac26"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:30.476229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:30.476158    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee0a8ae-c78f-4e23-a37f-24f227aaac26-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:30.995860 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:30.995826    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.096316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.096277    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.181121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.181092    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"
Sep 11 12:45:31.181121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.181118    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr" event={"ID":"9ee0a8ae-c78f-4e23-a37f-24f227aaac26","Type":"ContainerDied","Data":"cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a"}
Sep 11 12:45:31.181296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.181160    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbb84ab3b4f7830cf2d12079ec29749fe3a20a74623d18cb5fa1e80fceba6b0a"
Sep 11 12:45:31.291068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.290965    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:45:31.291283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.291213    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" containerID="cri-o://887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac" gracePeriod=30
Sep 11 12:45:31.330379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.330349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.506481 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.506448    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.640537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.640440    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.741684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.741649    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.841946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.841918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:31.889997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.889973    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:45:31.989472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989439    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989478    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzbts\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989529    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989555    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989593    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989618    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989643    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989677    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.989809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989717    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:31.989809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989736    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo\") pod \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\" (UID: \"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4\") "
Sep 11 12:45:31.990010 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.989987    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:31.990107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.990024    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:31.990161 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.990102    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:31.990213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.990195    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data" (OuterVolumeSpecName: "istio-data") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:31.990356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.990335    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:31.991787 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.991766    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token" (OuterVolumeSpecName: "istio-token") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:31.991884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.991867    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts" (OuterVolumeSpecName: "kube-api-access-qzbts") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "kube-api-access-qzbts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:31.992000 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.991985    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:31.992085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:31.992069    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" (UID: "19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:45:32.090780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090757    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090778    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzbts\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-kube-api-access-qzbts\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090787    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090795    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090803    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090811    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090820    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.090889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.090832    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:32.188732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.188632    2584 generic.go:356] "Generic (PLEG): container finished" podID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerID="2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc" exitCode=0
Sep 11 12:45:32.188732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.188673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerDied","Data":"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"}
Sep 11 12:45:32.188732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.188695    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"
Sep 11 12:45:32.188945 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.188736    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n" event={"ID":"19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4","Type":"ContainerDied","Data":"b069bc61c9c37fa8007a39f77d3ca19524de6311bb59c3a1faf51067180902f1"}
Sep 11 12:45:32.188945 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.188771    2584 scope.go:117] "RemoveContainer" containerID="2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"
Sep 11 12:45:32.198284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.198267    2584 scope.go:117] "RemoveContainer" containerID="749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"
Sep 11 12:45:32.206345 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.206330    2584 scope.go:117] "RemoveContainer" containerID="2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"
Sep 11 12:45:32.206590 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:32.206574    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc\": container with ID starting with 2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc not found: ID does not exist" containerID="2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"
Sep 11 12:45:32.206625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.206599    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc"} err="failed to get container status \"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc\": rpc error: code = NotFound desc = could not find container \"2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc\": container with ID starting with 2b15cc35d0bcdc607b0f929632cb361d101812fe9e69d3373057b4597316d7fc not found: ID does not exist"
Sep 11 12:45:32.206625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.206613    2584 scope.go:117] "RemoveContainer" containerID="749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"
Sep 11 12:45:32.206825 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:32.206809    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1\": container with ID starting with 749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1 not found: ID does not exist" containerID="749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"
Sep 11 12:45:32.206861 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.206830    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1"} err="failed to get container status \"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1\": rpc error: code = NotFound desc = could not find container \"749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1\": container with ID starting with 749d463beebcfe8b4623317ecbe6c5e913f5f6c5509f87dca405fd3999aa8cf1 not found: ID does not exist"
Sep 11 12:45:32.213010 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.212991    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:45:32.217576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:32.217553    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-edce0b-openshift-default-6958dc7c9b-dbv7n"]
Sep 11 12:45:33.274939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:33.274902    2584 patch_prober.go:28] interesting pod/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:45:33.275366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:33.274965    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:45:33.877241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:33.877211    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" path="/var/lib/kubelet/pods/19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4/volumes"
Sep 11 12:45:36.535540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.535515    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:45:36.634084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634008    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634088    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634103    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f82sk\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634138    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634157    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634189    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634217    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634258    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket\") pod \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\" (UID: \"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2\") "
Sep 11 12:45:36.634592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634301    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:36.634592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634525    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.634759 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634739    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:36.634816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634761    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:36.634816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.634694    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:36.635229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.635194    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:36.636472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.636448    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk" (OuterVolumeSpecName: "kube-api-access-f82sk") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "kube-api-access-f82sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:36.636566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.636474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:36.636566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.636491    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:45:36.636801 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.636787    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" (UID: "8527bd86-1519-40b8-aa7d-c4c0ad5a41b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:36.735828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735796    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.735828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735825    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f82sk\" (UniqueName: \"kubernetes.io/projected/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-kube-api-access-f82sk\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.735828 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735835    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.736062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735843    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.736062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735851    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.736062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735860    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.736062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735870    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:36.736062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:36.735882    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:37.219595 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.219562    2584 generic.go:356] "Generic (PLEG): container finished" podID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerID="887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac" exitCode=0
Sep 11 12:45:37.219795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.219610    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"
Sep 11 12:45:37.219795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.219649    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerDied","Data":"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"}
Sep 11 12:45:37.219795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.219712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws" event={"ID":"8527bd86-1519-40b8-aa7d-c4c0ad5a41b2","Type":"ContainerDied","Data":"36c7d949e5a8b437fc1c487458aa425ddfd1a2175ab36f5dcae2dedd1dbe7d47"}
Sep 11 12:45:37.219795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.219744    2584 scope.go:117] "RemoveContainer" containerID="887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"
Sep 11 12:45:37.229313 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.229297    2584 scope.go:117] "RemoveContainer" containerID="b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"
Sep 11 12:45:37.237607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.237588    2584 scope.go:117] "RemoveContainer" containerID="887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"
Sep 11 12:45:37.237866 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:37.237849    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac\": container with ID starting with 887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac not found: ID does not exist" containerID="887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"
Sep 11 12:45:37.237946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.237873    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac"} err="failed to get container status \"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac\": rpc error: code = NotFound desc = could not find container \"887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac\": container with ID starting with 887f78effa1ae1a627bc1fbc8c0b6d5445067da3e4a3eb0621a1b10219bddaac not found: ID does not exist"
Sep 11 12:45:37.237946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.237901    2584 scope.go:117] "RemoveContainer" containerID="b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"
Sep 11 12:45:37.238193 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:37.238175    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217\": container with ID starting with b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217 not found: ID does not exist" containerID="b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"
Sep 11 12:45:37.238266 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.238196    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217"} err="failed to get container status \"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217\": rpc error: code = NotFound desc = could not find container \"b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217\": container with ID starting with b69abad73d4130a596da490367b1ad23297922b2449aa8baaa5584f4120bc217 not found: ID does not exist"
Sep 11 12:45:37.241549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.241526    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:45:37.246918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.246894    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-54e055b6-openshift-default-5f6d6db49b-fbrws"]
Sep 11 12:45:37.470800 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.470704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:37.573718 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.573679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:37.669274 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.669240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:37.669904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.669861    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"]
Sep 11 12:45:37.672325 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.672307    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f06aba-lk8cr"]
Sep 11 12:45:37.773749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.773716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:37.876968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.876938    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" path="/var/lib/kubelet/pods/8527bd86-1519-40b8-aa7d-c4c0ad5a41b2/volumes"
Sep 11 12:45:37.877301 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:37.877288    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee0a8ae-c78f-4e23-a37f-24f227aaac26" path="/var/lib/kubelet/pods/9ee0a8ae-c78f-4e23-a37f-24f227aaac26/volumes"
Sep 11 12:45:38.003305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:38.003267    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:38.070131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:38.070019    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:38.161992 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:38.161956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:38.327869 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:38.327782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:40.080235 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:40.080204    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:45:44.224883 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.224846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:44.325242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.325210    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:44.461147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.461114    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:45:44.461349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.461326    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy" containerID="cri-o://45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042" gracePeriod=30
Sep 11 12:45:44.485465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.485434    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:44.792071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.791948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:44.893297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.893261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:44.998057 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:44.997996    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:45.273678 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.273646    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:45:45.274064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274022    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.274064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274063    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274076    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274081    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274092    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274098    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274110    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee0a8ae-c78f-4e23-a37f-24f227aaac26" containerName="revoke-keys"
Sep 11 12:45:45.274145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274115    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee0a8ae-c78f-4e23-a37f-24f227aaac26" containerName="revoke-keys"
Sep 11 12:45:45.274424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274188    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee0a8ae-c78f-4e23-a37f-24f227aaac26" containerName="revoke-keys"
Sep 11 12:45:45.274424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274199    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274209    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ec7e51-f2ff-4df0-8f6a-f6d33a2f0ae4" containerName="istio-proxy"
Sep 11 12:45:45.274424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274215    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.274424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.274223    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.278985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.278964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.281673 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.281652    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-c0bbb3-openshift-default-dockercfg-gwwms\""
Sep 11 12:45:45.288808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.288789    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:45:45.300921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.300897    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:45.410803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.410771    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.410803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.410804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.410822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.410844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.410947    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.411000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.411054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfwt\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.411084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.411330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.411162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512365 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512365 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfwt\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512549    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.512823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.512682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.513187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.513157    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.513308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.513163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.513308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.513220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.513308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.513222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.514955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.514925    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.515069 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.515020    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.522112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.522086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfwt\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.522268 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.522216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token\") pod \"e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") " pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.588134 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.588065    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:45.589947 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.589930    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:45.685022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.684986    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:45.870322 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.870299    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:45:45.872716 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:45.872687    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7c0e1d_9620_463d_98db_7d688c4eecf4.slice/crio-545d64b0877a2d287a827fbad13c806f7c1e8d4c5e498e724082388a0fa30e1a WatchSource:0}: Error finding container 545d64b0877a2d287a827fbad13c806f7c1e8d4c5e498e724082388a0fa30e1a: Status 404 returned error can't find the container with id 545d64b0877a2d287a827fbad13c806f7c1e8d4c5e498e724082388a0fa30e1a
Sep 11 12:45:45.875128 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.875091    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:45.875243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.875177    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:45.875243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.875223    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:45.928244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.928219    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:45:45.928747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.928732    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.928808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.928751    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8527bd86-1519-40b8-aa7d-c4c0ad5a41b2" containerName="istio-proxy"
Sep 11 12:45:45.933533 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.933509    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:45.936374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.936356    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-ce2636-openshift-default-dockercfg-pwpjw\""
Sep 11 12:45:45.944019 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.943990    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:45:45.955451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:45.955419    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:46.016651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016871    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016898    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8kjr\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016995 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.016995 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.016985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.017087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.017072    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.107317 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.107284    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:46.118222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118231    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118299    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118360    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kjr\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118585 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118505    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.118785 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.119081 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.118999    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.119218 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.119112    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.119283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.119230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.119283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.119241    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.120651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.120595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.120752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.120731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.127783 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.127760    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.128098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.128075    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kjr\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr\") pod \"e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") " pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.245405 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.245369    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:46.281924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.281884    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerStarted","Data":"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"}
Sep 11 12:45:46.282297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.281946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerStarted","Data":"545d64b0877a2d287a827fbad13c806f7c1e8d4c5e498e724082388a0fa30e1a"}
Sep 11 12:45:46.304223 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.303648    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podStartSLOduration=1.303623838 podStartE2EDuration="1.303623838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:46.301831605 +0000 UTC m=+1138.945724262" watchObservedRunningTime="2026-09-11 12:45:46.303623838 +0000 UTC m=+1138.947516496"
Sep 11 12:45:46.522930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.522899    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:45:46.525002 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:45:46.524965    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe06435_1350_4b01_8069_1acbeb8ca874.slice/crio-eb4260e687271befc280b8e7ee1a205be0262a090ad6de130318c87736452f50 WatchSource:0}: Error finding container eb4260e687271befc280b8e7ee1a205be0262a090ad6de130318c87736452f50: Status 404 returned error can't find the container with id eb4260e687271befc280b8e7ee1a205be0262a090ad6de130318c87736452f50
Sep 11 12:45:46.527943 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.527902    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:46.528077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.527982    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:46.528077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.528020    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:45:46.590926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.590889    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:46.595646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:46.595622    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:47.289704 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:47.289667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerStarted","Data":"b88351c29d6e831ba251acd22efdbbcd4093758320d2b61ec7a10ab876e07f63"}
Sep 11 12:45:47.290226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:47.289719    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerStarted","Data":"eb4260e687271befc280b8e7ee1a205be0262a090ad6de130318c87736452f50"}
Sep 11 12:45:47.290226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:47.290128    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:47.291103 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:47.291082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:45:47.315353 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:47.315306    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podStartSLOduration=2.315291954 podStartE2EDuration="2.315291954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:47.314205809 +0000 UTC m=+1139.958098465" watchObservedRunningTime="2026-09-11 12:45:47.315291954 +0000 UTC m=+1139.959184610"
Sep 11 12:45:48.179404 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.179371    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:48.246359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.246327    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:48.251154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.251132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:48.280228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.280160    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:48.295202 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.295173    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:48.296342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:48.296324    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:45:49.316667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.316632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:49.422260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.422218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:49.514007 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.513972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:49.619280 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.619188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:49.715389 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.715360    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:45:49.855908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855810    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htz45\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.855908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855850    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.855908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855886    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855932    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855965    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.855995    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856016    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856060    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856090    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket\") pod \"5a38af68-cd20-4dec-9842-7dfba4856397\" (UID: \"5a38af68-cd20-4dec-9842-7dfba4856397\") "
Sep 11 12:45:49.856237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:49.856580 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856363    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.856637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856605    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:49.856810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856697    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:49.856989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.856776    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:49.857178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.857153    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:49.858582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.858552    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45" (OuterVolumeSpecName: "kube-api-access-htz45") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "kube-api-access-htz45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:49.858831 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.858802    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:49.858926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.858885    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:45:49.859005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.858985    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a38af68-cd20-4dec-9842-7dfba4856397" (UID: "5a38af68-cd20-4dec-9842-7dfba4856397"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:45:49.900152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.900117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:49.957046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957006    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htz45\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-kube-api-access-htz45\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957039    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a38af68-cd20-4dec-9842-7dfba4856397-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957046 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957050    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957058    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a38af68-cd20-4dec-9842-7dfba4856397-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957071    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a38af68-cd20-4dec-9842-7dfba4856397-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957083    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957090    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.957321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.957097    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a38af68-cd20-4dec-9842-7dfba4856397-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:45:49.995366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:49.995328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:50.309723 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.309688    2584 generic.go:356] "Generic (PLEG): container finished" podID="5a38af68-cd20-4dec-9842-7dfba4856397" containerID="45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042" exitCode=0
Sep 11 12:45:50.309879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.309742    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"
Sep 11 12:45:50.309879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.309773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerDied","Data":"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"}
Sep 11 12:45:50.309879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.309870    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl" event={"ID":"5a38af68-cd20-4dec-9842-7dfba4856397","Type":"ContainerDied","Data":"fc3757a099b02f2c12ab9b8d6e1be7ee87fce9aa90b7a63f1edc70b577b6bea3"}
Sep 11 12:45:50.310107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.309912    2584 scope.go:117] "RemoveContainer" containerID="45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"
Sep 11 12:45:50.321189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.321157    2584 scope.go:117] "RemoveContainer" containerID="c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"
Sep 11 12:45:50.329913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.329869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:45:50.332087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.332061    2584 scope.go:117] "RemoveContainer" containerID="45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"
Sep 11 12:45:50.332392 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:50.332369    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042\": container with ID starting with 45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042 not found: ID does not exist" containerID="45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"
Sep 11 12:45:50.332477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.332400    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042"} err="failed to get container status \"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042\": rpc error: code = NotFound desc = could not find container \"45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042\": container with ID starting with 45af5a1696a2065e6a0b4999d01cf3c1f807f9621616300fbc962b1da39d7042 not found: ID does not exist"
Sep 11 12:45:50.332477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.332419    2584 scope.go:117] "RemoveContainer" containerID="c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"
Sep 11 12:45:50.332692 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:45:50.332673    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669\": container with ID starting with c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669 not found: ID does not exist" containerID="c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"
Sep 11 12:45:50.332748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.332699    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669"} err="failed to get container status \"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669\": rpc error: code = NotFound desc = could not find container \"c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669\": container with ID starting with c1fecfab26d7f1164827631586e23e092e1497c89da5483dbbb0369677b26669 not found: ID does not exist"
Sep 11 12:45:50.332975 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.332958    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f06aba-openshift-default-56f5b96b8d-gg6cl"]
Sep 11 12:45:50.889900 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.889862    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:50.991207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:50.991167    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:51.230283 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:51.230197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:51.354600 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:51.354567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:51.453983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:51.453932    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:51.877127 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:51.877093    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" path="/var/lib/kubelet/pods/5a38af68-cd20-4dec-9842-7dfba4856397/volumes"
Sep 11 12:45:52.827920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:52.827882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:45:53.789285 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:45:53.789243    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:46:03.668891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:03.668649    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": read tcp 10.133.0.2:57332->10.133.0.80:15021: read: connection reset by peer" start-of-body=
Sep 11 12:46:03.668891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:03.668712    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": read tcp 10.133.0.2:57332->10.133.0.80:15021: read: connection reset by peer"
Sep 11 12:46:04.404336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.404301    2584 generic.go:356] "Generic (PLEG): container finished" podID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerID="b88351c29d6e831ba251acd22efdbbcd4093758320d2b61ec7a10ab876e07f63" exitCode=0
Sep 11 12:46:04.404513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.404377    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerDied","Data":"b88351c29d6e831ba251acd22efdbbcd4093758320d2b61ec7a10ab876e07f63"}
Sep 11 12:46:04.404776 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.404762    2584 scope.go:117] "RemoveContainer" containerID="b88351c29d6e831ba251acd22efdbbcd4093758320d2b61ec7a10ab876e07f63"
Sep 11 12:46:04.405737 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.405707    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:04.405790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.405777    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:04.405832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.405808    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:04.535279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.535243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:04.635760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:04.635724    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:05.413004 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:05.412973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerStarted","Data":"45f0340c3e543f733b299a36764854cd7eb7c42d06097c25d9fc3e324f2f0fd7"}
Sep 11 12:46:06.246379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:06.246347    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:46:06.246888 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:06.246683    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 12:46:06.247105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:06.247070    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 12:46:07.246446 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:07.246407    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 12:46:07.247164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:07.247112    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 12:46:08.246005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:08.245965    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 12:46:08.246234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:08.246045    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 12:46:09.246473 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:09.246431    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 12:46:09.247135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:09.247093    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 12:46:10.246249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:10.246167    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 12:46:10.246531 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:10.246503    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 12:46:10.444705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:10.444666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:11.250754 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:11.250722    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:46:11.251234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:11.251093    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:46:11.251686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:11.251667    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:46:12.720967 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:12.720929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:13.133731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.133697    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:13.446688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.446586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:13.710187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710110    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:46:13.710602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710582    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.710602 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710604    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.710770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710623    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.710770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710631    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.710770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710740    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.710770 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.710752    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a38af68-cd20-4dec-9842-7dfba4856397" containerName="istio-proxy"
Sep 11 12:46:13.712691 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.712669    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.715297 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.715273    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-1337fa-openshift-default-dockercfg-j25bf\""
Sep 11 12:46:13.739045 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.727450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:46:13.751054 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.745452    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:13.892022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.891993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhs5g\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.892436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.892331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.927471 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.927442    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:13.993380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993654    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhs5g\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993790 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993766    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.993973 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.993951    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994015    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994073 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994290 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.994613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.994544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.995803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.995779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:13.996390 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:13.996373    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:14.001372 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.001348    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhs5g\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:14.001559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.001538    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token\") pod \"e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") " pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:14.039086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.039056    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:14.112796 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.112762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:14.320053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.320014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:46:14.321452 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:14.321416    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ff7b12_1df3_478a_b07d_a995a2991079.slice/crio-8f3280a3a016b42b96388e58d69a7330a72823ca737a849c5bd8cd302a0723ab WatchSource:0}: Error finding container 8f3280a3a016b42b96388e58d69a7330a72823ca737a849c5bd8cd302a0723ab: Status 404 returned error can't find the container with id 8f3280a3a016b42b96388e58d69a7330a72823ca737a849c5bd8cd302a0723ab
Sep 11 12:46:14.324064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.324003    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:14.324159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.324107    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:14.324159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.324146    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:14.428022 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.427955    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:14.489424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.489390    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerStarted","Data":"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"}
Sep 11 12:46:14.489608 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.489470    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerStarted","Data":"8f3280a3a016b42b96388e58d69a7330a72823ca737a849c5bd8cd302a0723ab"}
Sep 11 12:46:14.510744 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.510698    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podStartSLOduration=1.510684381 podStartE2EDuration="1.510684381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:14.509417103 +0000 UTC m=+1167.153309760" watchObservedRunningTime="2026-09-11 12:46:14.510684381 +0000 UTC m=+1167.154577033"
Sep 11 12:46:14.688985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.688903    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:46:14.691351 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.691328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.694055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.694016    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-5db8fe-openshift-default-dockercfg-zrzl6\""
Sep 11 12:46:14.700669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.700783 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.700855 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.700913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.700913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.701024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvbp\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.701024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.701024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.700989    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.701024 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.701014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.705084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.705057    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:46:14.715653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.715627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:14.801705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801652    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.801705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvbp\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801759    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.801929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.802312    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.802513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.802546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.802631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.802884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.802769    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.804194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.804163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.805094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.805077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.809943 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.809922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:14.810220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:14.810202    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvbp\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp\") pod \"e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") " pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:15.002956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.002899    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:15.042051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.041717    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:15.042051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.041873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:15.052871 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.052585    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:15.307668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.307644    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:46:15.309077 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:15.309049    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f9941e_441b_44b0_be41_af76a14b3da9.slice/crio-2232c152c37b9e5cc800ef038bff8ea67032845f3b7d5fa90bfb0787038f9228 WatchSource:0}: Error finding container 2232c152c37b9e5cc800ef038bff8ea67032845f3b7d5fa90bfb0787038f9228: Status 404 returned error can't find the container with id 2232c152c37b9e5cc800ef038bff8ea67032845f3b7d5fa90bfb0787038f9228
Sep 11 12:46:15.311240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.311204    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:15.311316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.311292    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:15.311354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.311335    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:15.498565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.498523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerStarted","Data":"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"}
Sep 11 12:46:15.498763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.498589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerStarted","Data":"2232c152c37b9e5cc800ef038bff8ea67032845f3b7d5fa90bfb0787038f9228"}
Sep 11 12:46:15.498939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.498883    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:15.499954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.499933    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:15.521548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:15.521501    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podStartSLOduration=1.521485047 podStartE2EDuration="1.521485047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:15.519896011 +0000 UTC m=+1168.163788672" watchObservedRunningTime="2026-09-11 12:46:15.521485047 +0000 UTC m=+1168.165377705"
Sep 11 12:46:16.003951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.003909    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:16.009217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.009193    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:16.404683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.404579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:16.499725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.499680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:16.504984 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.504958    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:16.506011 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:16.505994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:17.409760 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:17.409719    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:17.509703 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:17.509651    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:17.615241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:17.615197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:17.718798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:17.718687    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:17.813305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:17.813258    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:18.089175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.089137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:18.157699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.157647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:18.332864 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.332826    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:46:18.333269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.333233    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:46:18.450434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.450346    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:18.992012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.991975    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:46:18.996859 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.996830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:18.999705 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.999679    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:46:18.999852 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.999686    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-5db8fe-serving-cert\""
Sep 11 12:46:18.999852 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:18.999742    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v6tqs\""
Sep 11 12:46:19.000980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.000956    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 12:46:19.001109 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.000990    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 12:46:19.007749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.007690    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:46:19.029699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.029653    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.040988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.040961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.041121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.040991    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.041121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.041020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfwr\" (UniqueName: \"kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.041201 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.041149    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.133335 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.133301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.142596 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.142565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.142714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.142611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.142714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.142648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfwr\" (UniqueName: \"kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.142714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.142704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.142883 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:19.142782    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-serving-cert: secret "maas-api-e2e-shared-b-w2-5db8fe-serving-cert" not found
Sep 11 12:46:19.142938 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:19.142890    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls podName:2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5 nodeName:}" failed. No retries permitted until 2026-09-11 12:46:19.642868213 +0000 UTC m=+1172.286760861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls") pod "maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" (UID: "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5") : secret "maas-api-e2e-shared-b-w2-5db8fe-serving-cert" not found
Sep 11 12:46:19.143467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.143444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.145194 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.145171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.151187 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.151167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfwr\" (UniqueName: \"kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.293899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.293811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.528175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.528134    2584 generic.go:356] "Generic (PLEG): container finished" podID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerID="94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d" exitCode=0
Sep 11 12:46:19.528634 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.528213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerDied","Data":"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"}
Sep 11 12:46:19.528695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.528674    2584 scope.go:117] "RemoveContainer" containerID="94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"
Sep 11 12:46:19.529918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.529882    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:19.530053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.529978    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:19.530053 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.530009    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:19.591615 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.591589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.647306 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.647269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.650388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.650362    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:19.660237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.660202    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.883457 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.883374    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:19.912424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:19.912398    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:20.193874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.192910    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:46:20.195274 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:20.195248    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2cfc1f_e6e2_44a9_adc1_4dfb542bfee5.slice/crio-43736261b0080b2b19d3a8a5106f9f812108f8deccc3f11eb5fa648f2fb1a57b WatchSource:0}: Error finding container 43736261b0080b2b19d3a8a5106f9f812108f8deccc3f11eb5fa648f2fb1a57b: Status 404 returned error can't find the container with id 43736261b0080b2b19d3a8a5106f9f812108f8deccc3f11eb5fa648f2fb1a57b
Sep 11 12:46:20.197218 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.197198    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:46:20.536169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.536136    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerStarted","Data":"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"}
Sep 11 12:46:20.537482 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.537456    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" event={"ID":"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5","Type":"ContainerStarted","Data":"43736261b0080b2b19d3a8a5106f9f812108f8deccc3f11eb5fa648f2fb1a57b"}
Sep 11 12:46:20.590287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.590258    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:46:20.590447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.590427    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:20.590529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.590475    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:20.604961 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:20.604929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:21.590754 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:21.590703    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:21.591144 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:21.590776    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:22.591325 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:22.591288    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:22.591782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:22.591363    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:23.569191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:23.569153    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" event={"ID":"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5","Type":"ContainerStarted","Data":"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"}
Sep 11 12:46:23.569374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:23.569268    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:23.590431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:23.590377    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" podStartSLOduration=2.622893088 podStartE2EDuration="5.590361565s" totalImagesPullingTime="2.967468477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:23.589463806 +0000 UTC m=+1176.233356463" watchObservedRunningTime="2026-09-11 12:46:23.590361565 +0000 UTC m=+1176.234254221"
Sep 11 12:46:23.590712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:23.590687    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:23.590820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:23.590740    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:24.590394 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:24.590358    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:24.590761 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:24.590419    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:25.592114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:25.591198    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 11 12:46:25.592114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:25.591274    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 11 12:46:26.594553 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:26.594523    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:46:26.594927 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:26.594767    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:46:26.595551 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:26.595535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:46:26.784231 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:26.784198    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:46:29.582131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:29.582100    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:46:36.666221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.666185    2584 generic.go:356] "Generic (PLEG): container finished" podID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerID="096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2" exitCode=0
Sep 11 12:46:36.666621 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.666259    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerDied","Data":"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"}
Sep 11 12:46:36.666666 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.666650    2584 scope.go:117] "RemoveContainer" containerID="096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"
Sep 11 12:46:36.667733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.667708    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:36.667802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.667776    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:36.667837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:36.667826    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:37.674544 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:37.674507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerStarted","Data":"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"}
Sep 11 12:46:38.040286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:38.040240    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:38.040728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:38.040286    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 12:46:38.040965 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:38.040930    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 12:46:39.039786 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:39.039746    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 12:46:39.040378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:39.040346    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 12:46:40.039896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:40.039849    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 12:46:40.040402 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:40.039927    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 12:46:40.808425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:40.808392    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:41.040237 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:41.040199    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 12:46:41.040812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:41.040780    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 12:46:41.522941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:41.522906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:42.039730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:42.039691    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 12:46:42.040047 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:42.039999    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 12:46:42.153052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:42.152993    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:42.396887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:42.396796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:43.113474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.113436    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-f985f5"]
Sep 11 12:46:43.121328 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.121300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:43.121945 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.121918    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-f985f5"]
Sep 11 12:46:43.124482 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.124454    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f4fwg\""
Sep 11 12:46:43.151055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.148195    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:43.151055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.148953    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:43.159278 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.159253    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:46:43.296779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.296741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqzzf\" (UniqueName: \"kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf\") pod \"test-curl-7642-f985f5\" (UID: \"81b141e6-82e6-4154-a26d-4abc54301208\") " pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:43.397999 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.397918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqzzf\" (UniqueName: \"kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf\") pod \"test-curl-7642-f985f5\" (UID: \"81b141e6-82e6-4154-a26d-4abc54301208\") " pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:43.406120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.406096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqzzf\" (UniqueName: \"kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf\") pod \"test-curl-7642-f985f5\" (UID: \"81b141e6-82e6-4154-a26d-4abc54301208\") " pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:43.449100 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.449060    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:43.721559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:43.721530    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-f985f5"]
Sep 11 12:46:44.719240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:44.719206    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-f985f5" event={"ID":"81b141e6-82e6-4154-a26d-4abc54301208","Type":"ContainerStarted","Data":"3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63"}
Sep 11 12:46:44.719240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:44.719246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-f985f5" event={"ID":"81b141e6-82e6-4154-a26d-4abc54301208","Type":"ContainerStarted","Data":"332eb7d41d89e4d4a33528edf7be66b83f36e6fcae058dbb22a0c286115e4234"}
Sep 11 12:46:44.739357 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:44.739300    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-f985f5" podStartSLOduration=1.739277779 podStartE2EDuration="1.739277779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:44.739217572 +0000 UTC m=+1197.383110229" watchObservedRunningTime="2026-09-11 12:46:44.739277779 +0000 UTC m=+1197.383170436"
Sep 11 12:46:45.326579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.326541    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-f985f5"]
Sep 11 12:46:45.330191 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.330160    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-f985f5"]
Sep 11 12:46:45.445996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.445875    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-6867ac"]
Sep 11 12:46:45.446644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.446618    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b141e6-82e6-4154-a26d-4abc54301208" containerName="test-curl-7642-f985f5"
Sep 11 12:46:45.446764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.446657    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b141e6-82e6-4154-a26d-4abc54301208" containerName="test-curl-7642-f985f5"
Sep 11 12:46:45.446827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.446786    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b141e6-82e6-4154-a26d-4abc54301208" containerName="test-curl-7642-f985f5"
Sep 11 12:46:45.450640 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.450621    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:45.457560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.457535    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-6867ac"]
Sep 11 12:46:45.518374 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.518351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grjt\" (UniqueName: \"kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt\") pod \"test-curl-7642-6867ac\" (UID: \"0acbbfb8-197a-496c-896d-23a3d766ef8b\") " pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:45.619707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.619669    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grjt\" (UniqueName: \"kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt\") pod \"test-curl-7642-6867ac\" (UID: \"0acbbfb8-197a-496c-896d-23a3d766ef8b\") " pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:45.628873 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.628836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grjt\" (UniqueName: \"kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt\") pod \"test-curl-7642-6867ac\" (UID: \"0acbbfb8-197a-496c-896d-23a3d766ef8b\") " pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:45.726410 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:45.726329    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-f985f5" container="test-curl-7642-f985f5"
Sep 11 12:46:45.762276 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:45.762240    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:46.036102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.036076    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-6867ac"]
Sep 11 12:46:46.037934 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:46.037900    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0acbbfb8_197a_496c_896d_23a3d766ef8b.slice/crio-818b9e0494ce77ef6f553c75eaa04b68f22fbf5a3e42dcadc33dd7cb6bb9a653 WatchSource:0}: Error finding container 818b9e0494ce77ef6f553c75eaa04b68f22fbf5a3e42dcadc33dd7cb6bb9a653: Status 404 returned error can't find the container with id 818b9e0494ce77ef6f553c75eaa04b68f22fbf5a3e42dcadc33dd7cb6bb9a653
Sep 11 12:46:46.443681 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.443601    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:46.735171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.735128    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-6867ac" event={"ID":"0acbbfb8-197a-496c-896d-23a3d766ef8b","Type":"ContainerStarted","Data":"d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec"}
Sep 11 12:46:46.735625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.735187    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-6867ac" event={"ID":"0acbbfb8-197a-496c-896d-23a3d766ef8b","Type":"ContainerStarted","Data":"818b9e0494ce77ef6f553c75eaa04b68f22fbf5a3e42dcadc33dd7cb6bb9a653"}
Sep 11 12:46:46.735625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.735243    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-f985f5" podUID="81b141e6-82e6-4154-a26d-4abc54301208" containerName="test-curl-7642-f985f5" containerID="cri-o://3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63" gracePeriod=2
Sep 11 12:46:46.753152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:46.753104    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-6867ac" podStartSLOduration=1.753087439 podStartE2EDuration="1.753087439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:46.750302497 +0000 UTC m=+1199.394195157" watchObservedRunningTime="2026-09-11 12:46:46.753087439 +0000 UTC m=+1199.396980099"
Sep 11 12:46:47.353924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.353882    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-6867ac"]
Sep 11 12:46:47.360062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.360015    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-6867ac"]
Sep 11 12:46:47.475959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.475880    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-c88db5"]
Sep 11 12:46:47.476286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.476272    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" containerName="test-curl-7642-6867ac"
Sep 11 12:46:47.476328 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.476286    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" containerName="test-curl-7642-6867ac"
Sep 11 12:46:47.476363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.476342    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" containerName="test-curl-7642-6867ac"
Sep 11 12:46:47.479398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.479381    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:47.485338 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.485312    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-c88db5"]
Sep 11 12:46:47.547174 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.547139    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:46:47.547324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.547196    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:46:47.642153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.642119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjvr\" (UniqueName: \"kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr\") pod \"test-curl-7642-c88db5\" (UID: \"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9\") " pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:47.741319 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:47.741290    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-6867ac" container="test-curl-7642-6867ac"
Sep 11 12:46:47.743202 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.743183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjvr\" (UniqueName: \"kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr\") pod \"test-curl-7642-c88db5\" (UID: \"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9\") " pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:47.751220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.751196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjvr\" (UniqueName: \"kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr\") pod \"test-curl-7642-c88db5\" (UID: \"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9\") " pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:47.790802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:47.790780    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:48.067549 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.067521    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-c88db5"]
Sep 11 12:46:48.068726 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:48.068695    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf240c36_0922_4e6c_baa7_f4a3f5a12fb9.slice/crio-9596fd65c5c9bef41dd437c16ffedd1cfedc79335b3958cb4c1b5bed64ae492e WatchSource:0}: Error finding container 9596fd65c5c9bef41dd437c16ffedd1cfedc79335b3958cb4c1b5bed64ae492e: Status 404 returned error can't find the container with id 9596fd65c5c9bef41dd437c16ffedd1cfedc79335b3958cb4c1b5bed64ae492e
Sep 11 12:46:48.750425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.750395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-c88db5" event={"ID":"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9","Type":"ContainerStarted","Data":"d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182"}
Sep 11 12:46:48.750755 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.750443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-c88db5" event={"ID":"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9","Type":"ContainerStarted","Data":"9596fd65c5c9bef41dd437c16ffedd1cfedc79335b3958cb4c1b5bed64ae492e"}
Sep 11 12:46:48.750755 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.750457    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-6867ac" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" containerName="test-curl-7642-6867ac" containerID="cri-o://d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec" gracePeriod=2
Sep 11 12:46:48.766809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.766772    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-c88db5" podStartSLOduration=1.766759416 podStartE2EDuration="1.766759416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:48.765721873 +0000 UTC m=+1201.409614531" watchObservedRunningTime="2026-09-11 12:46:48.766759416 +0000 UTC m=+1201.410652071"
Sep 11 12:46:48.919786 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:48.919763    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:49.056863 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.056798    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqzzf\" (UniqueName: \"kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf\") pod \"81b141e6-82e6-4154-a26d-4abc54301208\" (UID: \"81b141e6-82e6-4154-a26d-4abc54301208\") "
Sep 11 12:46:49.058690 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.058629    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf" (OuterVolumeSpecName: "kube-api-access-rqzzf") pod "81b141e6-82e6-4154-a26d-4abc54301208" (UID: "81b141e6-82e6-4154-a26d-4abc54301208"). InnerVolumeSpecName "kube-api-access-rqzzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:46:49.158184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.158155    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqzzf\" (UniqueName: \"kubernetes.io/projected/81b141e6-82e6-4154-a26d-4abc54301208-kube-api-access-rqzzf\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:46:49.345625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.345548    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-c88db5"]
Sep 11 12:46:49.351475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.351416    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-c88db5"]
Sep 11 12:46:49.459456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.459424    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7642-0682b2"]
Sep 11 12:46:49.459864 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.459850    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" containerName="test-curl-7642-c88db5"
Sep 11 12:46:49.459913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.459866    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" containerName="test-curl-7642-c88db5"
Sep 11 12:46:49.459948 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.459932    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" containerName="test-curl-7642-c88db5"
Sep 11 12:46:49.463015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.462997    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:49.469720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.469696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-0682b2"]
Sep 11 12:46:49.562090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.562057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4b4\" (UniqueName: \"kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4\") pod \"test-curl-7642-0682b2\" (UID: \"b8db447c-5c63-448b-bce5-49fbb5e732e2\") " pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:49.663055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.662972    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4b4\" (UniqueName: \"kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4\") pod \"test-curl-7642-0682b2\" (UID: \"b8db447c-5c63-448b-bce5-49fbb5e732e2\") " pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:49.671304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.671287    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4b4\" (UniqueName: \"kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4\") pod \"test-curl-7642-0682b2\" (UID: \"b8db447c-5c63-448b-bce5-49fbb5e732e2\") " pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:49.757430 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.757394    2584 generic.go:356] "Generic (PLEG): container finished" podID="81b141e6-82e6-4154-a26d-4abc54301208" containerID="3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63" exitCode=137
Sep 11 12:46:49.757786 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.757435    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:49.757786 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.757508    2584 scope.go:117] "RemoveContainer" containerID="3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63"
Sep 11 12:46:49.759318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.759299    2584 generic.go:356] "Generic (PLEG): container finished" podID="31f9941e-441b-44b0-be41-af76a14b3da9" containerID="9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a" exitCode=0
Sep 11 12:46:49.759407 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.759384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerDied","Data":"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"}
Sep 11 12:46:49.759527 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:49.759514    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-c88db5" container="test-curl-7642-c88db5"
Sep 11 12:46:49.759827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.759810    2584 scope.go:117] "RemoveContainer" containerID="9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"
Sep 11 12:46:49.760946 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.760918    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:49.761055 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.760995    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:49.761123 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.761062    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:49.767240 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.767220    2584 scope.go:117] "RemoveContainer" containerID="3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63"
Sep 11 12:46:49.767491 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:49.767473    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63\": container with ID starting with 3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63 not found: ID does not exist" containerID="3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63"
Sep 11 12:46:49.767548 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.767501    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63"} err="failed to get container status \"3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63\": rpc error: code = NotFound desc = could not find container \"3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63\": container with ID starting with 3224e3d01f5288bcee63441cf89f7121b06e808f88d33bdbf17844b68a28bd63 not found: ID does not exist"
Sep 11 12:46:49.773333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.773315    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:49.781908 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:49.781868    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-f985f5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="81b141e6-82e6-4154-a26d-4abc54301208" pod="opendatahub/test-curl-7642-f985f5"
Sep 11 12:46:49.879683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:49.879646    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b141e6-82e6-4154-a26d-4abc54301208" path="/var/lib/kubelet/pods/81b141e6-82e6-4154-a26d-4abc54301208/volumes"
Sep 11 12:46:50.053347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.053307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7642-0682b2"]
Sep 11 12:46:50.055750 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:50.055710    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8db447c_5c63_448b_bce5_49fbb5e732e2.slice/crio-6e508f34d279b90f9ce210ee6dcc35cb1ba18f7bbbf2761ec8eb2af143f712d9 WatchSource:0}: Error finding container 6e508f34d279b90f9ce210ee6dcc35cb1ba18f7bbbf2761ec8eb2af143f712d9: Status 404 returned error can't find the container with id 6e508f34d279b90f9ce210ee6dcc35cb1ba18f7bbbf2761ec8eb2af143f712d9
Sep 11 12:46:50.769175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.769144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-0682b2" event={"ID":"b8db447c-5c63-448b-bce5-49fbb5e732e2","Type":"ContainerStarted","Data":"0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e"}
Sep 11 12:46:50.769489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.769193    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7642-0682b2" event={"ID":"b8db447c-5c63-448b-bce5-49fbb5e732e2","Type":"ContainerStarted","Data":"6e508f34d279b90f9ce210ee6dcc35cb1ba18f7bbbf2761ec8eb2af143f712d9"}
Sep 11 12:46:50.770958 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.770930    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerStarted","Data":"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"}
Sep 11 12:46:50.771071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.770970    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-c88db5" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" containerName="test-curl-7642-c88db5" containerID="cri-o://d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182" gracePeriod=2
Sep 11 12:46:50.786081 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.786004    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7642-0682b2" podStartSLOduration=1.785989949 podStartE2EDuration="1.785989949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:50.784851766 +0000 UTC m=+1203.428744424" watchObservedRunningTime="2026-09-11 12:46:50.785989949 +0000 UTC m=+1203.429882606"
Sep 11 12:46:50.954286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:50.954199    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:51.003627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.003562    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:51.003755 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.003714    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 11 12:46:51.003796 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.003758    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 11 12:46:51.076855 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.076828    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4grjt\" (UniqueName: \"kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt\") pod \"0acbbfb8-197a-496c-896d-23a3d766ef8b\" (UID: \"0acbbfb8-197a-496c-896d-23a3d766ef8b\") "
Sep 11 12:46:51.078771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.078748    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt" (OuterVolumeSpecName: "kube-api-access-4grjt") pod "0acbbfb8-197a-496c-896d-23a3d766ef8b" (UID: "0acbbfb8-197a-496c-896d-23a3d766ef8b"). InnerVolumeSpecName "kube-api-access-4grjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:46:51.178009 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.177972    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4grjt\" (UniqueName: \"kubernetes.io/projected/0acbbfb8-197a-496c-896d-23a3d766ef8b-kube-api-access-4grjt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:46:51.407360 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.407259    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7642-0682b2"]
Sep 11 12:46:51.412836 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.412804    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7642-0682b2"]
Sep 11 12:46:51.781735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.781702    2584 generic.go:356] "Generic (PLEG): container finished" podID="0acbbfb8-197a-496c-896d-23a3d766ef8b" containerID="d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec" exitCode=137
Sep 11 12:46:51.782244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.781764    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:51.782244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.781811    2584 scope.go:117] "RemoveContainer" containerID="d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec"
Sep 11 12:46:51.782244 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:51.782190    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7642-0682b2" container="test-curl-7642-0682b2"
Sep 11 12:46:51.791077 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.791059    2584 scope.go:117] "RemoveContainer" containerID="d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec"
Sep 11 12:46:51.791330 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:51.791312    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec\": container with ID starting with d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec not found: ID does not exist" containerID="d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec"
Sep 11 12:46:51.791378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.791338    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec"} err="failed to get container status \"d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec\": rpc error: code = NotFound desc = could not find container \"d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec\": container with ID starting with d3d5fcb18eca35c551708030b9369039d1d9db5eef6e6b1be5ec6741c21d72ec not found: ID does not exist"
Sep 11 12:46:51.792012 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:51.791994    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-6867ac\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" pod="opendatahub/test-curl-7642-6867ac"
Sep 11 12:46:51.877003 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.876974    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0acbbfb8-197a-496c-896d-23a3d766ef8b" path="/var/lib/kubelet/pods/0acbbfb8-197a-496c-896d-23a3d766ef8b/volumes"
Sep 11 12:46:51.997613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:51.997570    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:52.003654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.003629    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 11 12:46:52.003752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.003687    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 11 12:46:52.142850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.142762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:52.294601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.294570    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:46:52.294971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.294960    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" containerName="test-curl-7642-0682b2"
Sep 11 12:46:52.295016 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.294974    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" containerName="test-curl-7642-0682b2"
Sep 11 12:46:52.295069 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.295063    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" containerName="test-curl-7642-0682b2"
Sep 11 12:46:52.299338 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.299320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.303050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.303008    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3fae345-openshift-default-dockercfg-tq526\""
Sep 11 12:46:52.320330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.320306    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:46:52.362798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.362764    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:52.388870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.388830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.388870 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.388874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.388921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4zj\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.388973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.388996    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.389014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.389060    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.389139    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.389342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.389179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490084 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4zj\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490588    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490707 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.490849 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.490820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.491284 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.491257    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.491586 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.491565    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.493565 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.493542    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.494230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.494207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.500102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.500079    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.501432 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.501406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4zj\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj\") pod \"e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") " pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.609879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.609839    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:52.700907 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.700855    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:52.788951 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.788900    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7642-0682b2" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" containerName="test-curl-7642-0682b2" containerID="cri-o://0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e" gracePeriod=2
Sep 11 12:46:52.908517 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.908488    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:46:52.909863 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:52.909839    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e051a7_cc43_4d42_a2b3_5db4da5d829c.slice/crio-0aa736ee92840a61bce08744a596e6023a196d120212b2b4781ee0a83469b950 WatchSource:0}: Error finding container 0aa736ee92840a61bce08744a596e6023a196d120212b2b4781ee0a83469b950: Status 404 returned error can't find the container with id 0aa736ee92840a61bce08744a596e6023a196d120212b2b4781ee0a83469b950
Sep 11 12:46:52.912287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.912255    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:52.912387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.912333    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:52.912387 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.912376    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:46:52.977981 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:52.977958    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:53.003254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.003225    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 11 12:46:53.003364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.003275    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 11 12:46:53.097049 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.096952    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckjvr\" (UniqueName: \"kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr\") pod \"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9\" (UID: \"cf240c36-0922-4e6c-baa7-f4a3f5a12fb9\") "
Sep 11 12:46:53.098987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.098963    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr" (OuterVolumeSpecName: "kube-api-access-ckjvr") pod "cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" (UID: "cf240c36-0922-4e6c-baa7-f4a3f5a12fb9"). InnerVolumeSpecName "kube-api-access-ckjvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:46:53.197904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.197864    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckjvr\" (UniqueName: \"kubernetes.io/projected/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9-kube-api-access-ckjvr\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:46:53.797110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.797002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerStarted","Data":"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"}
Sep 11 12:46:53.797110 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.797064    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerStarted","Data":"0aa736ee92840a61bce08744a596e6023a196d120212b2b4781ee0a83469b950"}
Sep 11 12:46:53.798397 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.798371    2584 generic.go:356] "Generic (PLEG): container finished" podID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" containerID="d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182" exitCode=137
Sep 11 12:46:53.798479 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.798404    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:53.798479 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.798464    2584 scope.go:117] "RemoveContainer" containerID="d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182"
Sep 11 12:46:53.808037 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.808003    2584 scope.go:117] "RemoveContainer" containerID="d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182"
Sep 11 12:46:53.808297 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:53.808278    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182\": container with ID starting with d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182 not found: ID does not exist" containerID="d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182"
Sep 11 12:46:53.808341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.808305    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182"} err="failed to get container status \"d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182\": rpc error: code = NotFound desc = could not find container \"d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182\": container with ID starting with d23b4552ea29046fe7691af4521f5bb0cea2006722a9ee12fa4843d94877b182 not found: ID does not exist"
Sep 11 12:46:53.820303 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:53.820276    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-c88db5\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" pod="opendatahub/test-curl-7642-c88db5"
Sep 11 12:46:53.820731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.820698    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podStartSLOduration=1.8206863580000001 podStartE2EDuration="1.820686358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:53.817971138 +0000 UTC m=+1206.461863794" watchObservedRunningTime="2026-09-11 12:46:53.820686358 +0000 UTC m=+1206.464579015"
Sep 11 12:46:53.878330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:53.878293    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf240c36-0922-4e6c-baa7-f4a3f5a12fb9" path="/var/lib/kubelet/pods/cf240c36-0922-4e6c-baa7-f4a3f5a12fb9/volumes"
Sep 11 12:46:54.004045 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.003995    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 11 12:46:54.004219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.004072    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 11 12:46:54.610152 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.610121    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:54.615202 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.615172    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:54.806655 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.806632    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:54.807696 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:54.807675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:46:55.003933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.003908    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 11 12:46:55.004100 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.003955    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 11 12:46:55.004924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.004900    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:55.115450 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.115419    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p4b4\" (UniqueName: \"kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4\") pod \"b8db447c-5c63-448b-bce5-49fbb5e732e2\" (UID: \"b8db447c-5c63-448b-bce5-49fbb5e732e2\") "
Sep 11 12:46:55.117229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.117201    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4" (OuterVolumeSpecName: "kube-api-access-6p4b4") pod "b8db447c-5c63-448b-bce5-49fbb5e732e2" (UID: "b8db447c-5c63-448b-bce5-49fbb5e732e2"). InnerVolumeSpecName "kube-api-access-6p4b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:46:55.217107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.217013    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p4b4\" (UniqueName: \"kubernetes.io/projected/b8db447c-5c63-448b-bce5-49fbb5e732e2-kube-api-access-6p4b4\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:46:55.689495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.689456    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:55.785652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.785617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:55.814234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.814202    2584 generic.go:356] "Generic (PLEG): container finished" podID="b8db447c-5c63-448b-bce5-49fbb5e732e2" containerID="0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e" exitCode=137
Sep 11 12:46:55.814685 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.814255    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:55.814685 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.814305    2584 scope.go:117] "RemoveContainer" containerID="0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e"
Sep 11 12:46:55.825078 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.824866    2584 scope.go:117] "RemoveContainer" containerID="0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e"
Sep 11 12:46:55.825245 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:55.825218    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e\": container with ID starting with 0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e not found: ID does not exist" containerID="0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e"
Sep 11 12:46:55.825318 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.825254    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e"} err="failed to get container status \"0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e\": rpc error: code = NotFound desc = could not find container \"0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e\": container with ID starting with 0bf7dc6b29d9bcd3fc61f25788dc0bcaccb086c5e4aa8893e4d4c37e2d64391e not found: ID does not exist"
Sep 11 12:46:55.826052 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:46:55.826000    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7642-0682b2\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" pod="opendatahub/test-curl-7642-0682b2"
Sep 11 12:46:55.877907 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:55.877876    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8db447c-5c63-448b-bce5-49fbb5e732e2" path="/var/lib/kubelet/pods/b8db447c-5c63-448b-bce5-49fbb5e732e2/volumes"
Sep 11 12:46:56.007112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.007089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:56.007486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.007468    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:56.008104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.008083    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:46:56.802832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.802804    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:46:56.807737 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.807716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:56.810535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.810511    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f3fae345-serving-cert\""
Sep 11 12:46:56.818815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.818793    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:46:56.844535 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.844509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:56.933255 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.933223    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:56.933423 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.933266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:56.933423 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.933287    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:56.933551 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.933453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxj4d\" (UniqueName: \"kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:56.943080 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:56.943024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:57.034310 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.034275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxj4d\" (UniqueName: \"kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.034447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.034357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.034447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.034390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.034447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.034411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.035196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.035170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.036803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.036782    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.036904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.036860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.047050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.047011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxj4d\" (UniqueName: \"kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d\") pod \"maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.065840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.065774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:57.118960 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.118937    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:57.368862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.368782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:57.398500 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.398461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:46:57.400298 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:46:57.400267    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a42273_5ee5_4933_97d2_98cfdb3ded2a.slice/crio-9764245d006430caa20d49b35e051390f35f815495b8f98b7037ad5bd8961ed6 WatchSource:0}: Error finding container 9764245d006430caa20d49b35e051390f35f815495b8f98b7037ad5bd8961ed6: Status 404 returned error can't find the container with id 9764245d006430caa20d49b35e051390f35f815495b8f98b7037ad5bd8961ed6
Sep 11 12:46:57.467810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.467774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:46:57.832085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:57.832054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" event={"ID":"58a42273-5ee5-4933-97d2-98cfdb3ded2a","Type":"ContainerStarted","Data":"9764245d006430caa20d49b35e051390f35f815495b8f98b7037ad5bd8961ed6"}
Sep 11 12:46:58.812321 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:58.812284    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:46:58.841429 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:58.841388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" event={"ID":"58a42273-5ee5-4933-97d2-98cfdb3ded2a","Type":"ContainerStarted","Data":"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"}
Sep 11 12:46:58.841869 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:58.841445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:46:58.867706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:46:58.867654    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" podStartSLOduration=2.4919473229999998 podStartE2EDuration="2.867638104s" totalImagesPullingTime="375.690781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:58.867239745 +0000 UTC m=+1211.511132402" watchObservedRunningTime="2026-09-11 12:46:58.867638104 +0000 UTC m=+1211.511530760"
Sep 11 12:47:04.853385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:04.853353    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:47:15.788971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:15.788931    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:47:18.995383 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.995352    2584 generic.go:356] "Generic (PLEG): container finished" podID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerID="0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3" exitCode=0
Sep 11 12:47:18.995862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.995425    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerDied","Data":"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"}
Sep 11 12:47:18.995862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.995802    2584 scope.go:117] "RemoveContainer" containerID="0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"
Sep 11 12:47:18.996899 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.996874    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:47:18.996953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.996940    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:47:18.996991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:18.996969    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:47:20.003982 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:20.003947    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerStarted","Data":"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"}
Sep 11 12:47:20.610071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:20.610009    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:47:20.610837 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:20.610816    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:20.610936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:20.610860    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:20.681936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:20.681871    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:21.610490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:21.610453    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:21.610879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:21.610510    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:21.942561 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:21.942473    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:22.610930 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:22.610892    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:22.611327 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:22.610960    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:23.610784 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:23.610749    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:23.610963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:23.610815    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:24.611193 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:24.611154    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:24.611559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:24.611212    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:24.807499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:24.807470    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:47:25.610878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:25.610790    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Sep 11 12:47:25.610878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:25.610854    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Sep 11 12:47:26.614411 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:26.614382    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:47:26.615271 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:26.615248    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:47:28.085743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:28.085702    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:47:29.067211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:29.067174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:36.990356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:36.990310    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:37.090984 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:37.090950    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:41.413809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:41.413727    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:47:46.589654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:46.589617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:47:48.040905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:48.040866    2584 scope.go:117] "RemoveContainer" containerID="876efb6c9d8c7cf35e4372b8703edaab21b2efb580529ec9f2ca544471724d46"
Sep 11 12:47:48.050434 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:47:48.050413    2584 scope.go:117] "RemoveContainer" containerID="ebc3a086e22b552f670a3e902dbb9cd6d77bfb4ce629866bde0d402115001870"
Sep 11 12:48:03.408892 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:03.408854    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:48:19.277676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:19.277641    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:48:25.828058 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:25.827993    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:25.930917 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:25.930879    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:37.677189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:37.677151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:48:41.089386 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.089353    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:48:41.089835 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.089596    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" podUID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" containerName="maas-api" containerID="cri-o://0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732" gracePeriod=30
Sep 11 12:48:41.119687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.119654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:41.347733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.343781    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:48:41.389913 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.389872    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:41.418274 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.418243    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls\") pod \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") "
Sep 11 12:48:41.418470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.418290    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs\") pod \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") "
Sep 11 12:48:41.418470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.418342    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca\") pod \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") "
Sep 11 12:48:41.418470 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.418406    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxj4d\" (UniqueName: \"kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d\") pod \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\" (UID: \"58a42273-5ee5-4933-97d2-98cfdb3ded2a\") "
Sep 11 12:48:41.418717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.418684    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58a42273-5ee5-4933-97d2-98cfdb3ded2a" (UID: "58a42273-5ee5-4933-97d2-98cfdb3ded2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:48:41.420756 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.420721    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58a42273-5ee5-4933-97d2-98cfdb3ded2a" (UID: "58a42273-5ee5-4933-97d2-98cfdb3ded2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:48:41.420901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.420864    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58a42273-5ee5-4933-97d2-98cfdb3ded2a" (UID: "58a42273-5ee5-4933-97d2-98cfdb3ded2a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:48:41.420901 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.420873    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d" (OuterVolumeSpecName: "kube-api-access-hxj4d") pod "58a42273-5ee5-4933-97d2-98cfdb3ded2a" (UID: "58a42273-5ee5-4933-97d2-98cfdb3ded2a"). InnerVolumeSpecName "kube-api-access-hxj4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:48:41.449198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.449164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:41.519904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.519871    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a42273-5ee5-4933-97d2-98cfdb3ded2a-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.519904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.519900    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxj4d\" (UniqueName: \"kubernetes.io/projected/58a42273-5ee5-4933-97d2-98cfdb3ded2a-kube-api-access-hxj4d\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.519904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.519911    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.520149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.519920    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a42273-5ee5-4933-97d2-98cfdb3ded2a-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.529118 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.529092    2584 generic.go:356] "Generic (PLEG): container finished" podID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" containerID="0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732" exitCode=0
Sep 11 12:48:41.529242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.529137    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"
Sep 11 12:48:41.529242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.529148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" event={"ID":"58a42273-5ee5-4933-97d2-98cfdb3ded2a","Type":"ContainerDied","Data":"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"}
Sep 11 12:48:41.529242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.529212    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz" event={"ID":"58a42273-5ee5-4933-97d2-98cfdb3ded2a","Type":"ContainerDied","Data":"9764245d006430caa20d49b35e051390f35f815495b8f98b7037ad5bd8961ed6"}
Sep 11 12:48:41.529242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.529235    2584 scope.go:117] "RemoveContainer" containerID="0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"
Sep 11 12:48:41.538926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.538909    2584 scope.go:117] "RemoveContainer" containerID="0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"
Sep 11 12:48:41.539207 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:48:41.539191    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732\": container with ID starting with 0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732 not found: ID does not exist" containerID="0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"
Sep 11 12:48:41.539256 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.539213    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732"} err="failed to get container status \"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732\": rpc error: code = NotFound desc = could not find container \"0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732\": container with ID starting with 0300f3d46b91a2fc06d7496051475bade548eb1cded0a04a857709764c88b732 not found: ID does not exist"
Sep 11 12:48:41.552038 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.552005    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:48:41.554777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.554758    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f3fae345-74f4f4b84c-x26nz"]
Sep 11 12:48:41.877489 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:41.877456    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" path="/var/lib/kubelet/pods/58a42273-5ee5-4933-97d2-98cfdb3ded2a/volumes"
Sep 11 12:48:44.338768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:44.338737    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:48.096238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:48.096205    2584 scope.go:117] "RemoveContainer" containerID="99c3db058414f4bfe54be66fccd6e6fba31f480ceb6c66180724506739fe3c53"
Sep 11 12:48:49.420385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:49.420345    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:48:54.478956 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:48:54.478920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:49:08.270695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:08.270658    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:49:22.577493 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:22.577412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:49:25.628519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:25.628438    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:26.924226 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:26.924188    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:32.057978 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.057937    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7645-05fdfa"]
Sep 11 12:49:32.058443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.058323    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" containerName="maas-api"
Sep 11 12:49:32.058443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.058334    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" containerName="maas-api"
Sep 11 12:49:32.058443 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.058412    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a42273-5ee5-4933-97d2-98cfdb3ded2a" containerName="maas-api"
Sep 11 12:49:32.061188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.061172    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:32.064217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.064198    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f4fwg\""
Sep 11 12:49:32.070238 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.070217    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-05fdfa"]
Sep 11 12:49:32.190919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.190878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfxt\" (UniqueName: \"kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt\") pod \"test-curl-7645-05fdfa\" (UID: \"07d5e36d-ef10-464b-a253-8458410f5409\") " pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:32.292068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.292012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfxt\" (UniqueName: \"kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt\") pod \"test-curl-7645-05fdfa\" (UID: \"07d5e36d-ef10-464b-a253-8458410f5409\") " pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:32.301172 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.301151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfxt\" (UniqueName: \"kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt\") pod \"test-curl-7645-05fdfa\" (UID: \"07d5e36d-ef10-464b-a253-8458410f5409\") " pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:32.370915 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.370840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:32.551826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.551789    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:32.642410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.642381    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-05fdfa"]
Sep 11 12:49:32.644163 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:49:32.644139    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07d5e36d_ef10_464b_a253_8458410f5409.slice/crio-a6b2f365f0786d812cd421168392f1e4be3749d8e95ee8bb45eee85163f11f36 WatchSource:0}: Error finding container a6b2f365f0786d812cd421168392f1e4be3749d8e95ee8bb45eee85163f11f36: Status 404 returned error can't find the container with id a6b2f365f0786d812cd421168392f1e4be3749d8e95ee8bb45eee85163f11f36
Sep 11 12:49:32.858088 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.858052    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-05fdfa" event={"ID":"07d5e36d-ef10-464b-a253-8458410f5409","Type":"ContainerStarted","Data":"ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8"}
Sep 11 12:49:32.858088 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.858099    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-05fdfa" event={"ID":"07d5e36d-ef10-464b-a253-8458410f5409","Type":"ContainerStarted","Data":"a6b2f365f0786d812cd421168392f1e4be3749d8e95ee8bb45eee85163f11f36"}
Sep 11 12:49:32.875979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:32.875931    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7645-05fdfa" podStartSLOduration=0.875918222 podStartE2EDuration="875.918222ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:49:32.874984585 +0000 UTC m=+1365.518877242" watchObservedRunningTime="2026-09-11 12:49:32.875918222 +0000 UTC m=+1365.519810879"
Sep 11 12:49:33.446140 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:33.446016    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7645-05fdfa"]
Sep 11 12:49:33.449679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:33.449647    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7645-05fdfa"]
Sep 11 12:49:33.864631 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:49:33.864597    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7645-05fdfa" container="test-curl-7645-05fdfa"
Sep 11 12:49:34.871002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:34.870963    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7645-05fdfa" podUID="07d5e36d-ef10-464b-a253-8458410f5409" containerName="test-curl-7645-05fdfa" containerID="cri-o://ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8" gracePeriod=2
Sep 11 12:49:35.174969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:35.174884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:36.411501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:36.411467    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:37.047686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.047660    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:37.139277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.139204    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgfxt\" (UniqueName: \"kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt\") pod \"07d5e36d-ef10-464b-a253-8458410f5409\" (UID: \"07d5e36d-ef10-464b-a253-8458410f5409\") "
Sep 11 12:49:37.141246 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.141221    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt" (OuterVolumeSpecName: "kube-api-access-mgfxt") pod "07d5e36d-ef10-464b-a253-8458410f5409" (UID: "07d5e36d-ef10-464b-a253-8458410f5409"). InnerVolumeSpecName "kube-api-access-mgfxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:49:37.240576 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.240545    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgfxt\" (UniqueName: \"kubernetes.io/projected/07d5e36d-ef10-464b-a253-8458410f5409-kube-api-access-mgfxt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:37.876976 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.876944    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d5e36d-ef10-464b-a253-8458410f5409" path="/var/lib/kubelet/pods/07d5e36d-ef10-464b-a253-8458410f5409/volumes"
Sep 11 12:49:37.889431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.889407    2584 generic.go:356] "Generic (PLEG): container finished" podID="07d5e36d-ef10-464b-a253-8458410f5409" containerID="ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8" exitCode=137
Sep 11 12:49:37.889555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.889436    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-05fdfa"
Sep 11 12:49:37.889555 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.889493    2584 scope.go:117] "RemoveContainer" containerID="ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8"
Sep 11 12:49:37.898714 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.898696    2584 scope.go:117] "RemoveContainer" containerID="ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8"
Sep 11 12:49:37.898954 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:49:37.898935    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8\": container with ID starting with ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8 not found: ID does not exist" containerID="ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8"
Sep 11 12:49:37.899010 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:37.898962    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8"} err="failed to get container status \"ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8\": rpc error: code = NotFound desc = could not find container \"ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8\": container with ID starting with ec0e48d93568ca624c0e1c66df112daa5f33ea286b486fe234a15f44e20e9bb8 not found: ID does not exist"
Sep 11 12:49:38.290903 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:38.290870    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:38.360044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:38.359993    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:38.539207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:38.539176    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:49:38.539437 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:38.539414    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" containerID="cri-o://7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a" gracePeriod=30
Sep 11 12:49:38.557645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:38.557571    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:39.686818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:39.686780    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:49:39.732501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:39.732451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:39.838241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:39.838196    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:39.931559 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:39.931523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:40.487650 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:40.487596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:40.583290 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:40.583254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:40.683820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:40.683781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:41.617040 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:41.616988    2584 patch_prober.go:28] interesting pod/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:49:41.617420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:41.617094    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:49:41.923827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:41.923740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:43.781671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.781647    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:49:43.907087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907002    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907064    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907098    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907123    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907165    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907197    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907232    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn4zj\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907304    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:49:43.907568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907320    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy\") pod \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\" (UID: \"13e051a7-cc43-4d42-a2b3-5db4da5d829c\") "
Sep 11 12:49:43.907568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907371    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:49:43.907568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907407    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:49:43.907568 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907524    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data" (OuterVolumeSpecName: "istio-data") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907576    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907707    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907727    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907745    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907758    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:43.907811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.907770    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:43.909354 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.909326    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj" (OuterVolumeSpecName: "kube-api-access-qn4zj") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "kube-api-access-qn4zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:49:43.909460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.909354    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token" (OuterVolumeSpecName: "istio-token") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:49:43.909695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.909672    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:49:43.909695 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.909686    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13e051a7-cc43-4d42-a2b3-5db4da5d829c" (UID: "13e051a7-cc43-4d42-a2b3-5db4da5d829c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:49:43.928363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.928338    2584 generic.go:356] "Generic (PLEG): container finished" podID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerID="7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a" exitCode=0
Sep 11 12:49:43.928499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.928386    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"
Sep 11 12:49:43.928499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.928420    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerDied","Data":"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"}
Sep 11 12:49:43.928499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.928472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t" event={"ID":"13e051a7-cc43-4d42-a2b3-5db4da5d829c","Type":"ContainerDied","Data":"0aa736ee92840a61bce08744a596e6023a196d120212b2b4781ee0a83469b950"}
Sep 11 12:49:43.928499 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.928493    2584 scope.go:117] "RemoveContainer" containerID="7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"
Sep 11 12:49:43.938156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.938136    2584 scope.go:117] "RemoveContainer" containerID="0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"
Sep 11 12:49:43.946349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.946333    2584 scope.go:117] "RemoveContainer" containerID="7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"
Sep 11 12:49:43.946615 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:49:43.946596    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a\": container with ID starting with 7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a not found: ID does not exist" containerID="7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"
Sep 11 12:49:43.946692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.946629    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a"} err="failed to get container status \"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a\": rpc error: code = NotFound desc = could not find container \"7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a\": container with ID starting with 7194b8b9f7dd35626940cb92c1076abeca1e94a0a9fdca07b93d590a76c8665a not found: ID does not exist"
Sep 11 12:49:43.946692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.946651    2584 scope.go:117] "RemoveContainer" containerID="0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"
Sep 11 12:49:43.946903 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:49:43.946889    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3\": container with ID starting with 0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3 not found: ID does not exist" containerID="0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"
Sep 11 12:49:43.946942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.946908    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3"} err="failed to get container status \"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3\": rpc error: code = NotFound desc = could not find container \"0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3\": container with ID starting with 0ba51f36ffc8545b073a99faf14dc5c9b3673bea03626f8f3f097a142c5722c3 not found: ID does not exist"
Sep 11 12:49:43.952426 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.952404    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:49:43.956116 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:43.956098    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3fae345-openshift-default-685b4c9b8-n8f8t"]
Sep 11 12:49:44.008804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:44.008786    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:44.008884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:44.008805    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn4zj\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-kube-api-access-qn4zj\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:44.008884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:44.008816    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:44.008884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:44.008824    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13e051a7-cc43-4d42-a2b3-5db4da5d829c-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:49:45.876846 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:45.876813    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" path="/var/lib/kubelet/pods/13e051a7-cc43-4d42-a2b3-5db4da5d829c/volumes"
Sep 11 12:49:46.583658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.583627    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:49:46.584013 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.583997    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:49:46.584117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584016    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:49:46.584117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584081    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d5e36d-ef10-464b-a253-8458410f5409" containerName="test-curl-7645-05fdfa"
Sep 11 12:49:46.584117 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584092    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d5e36d-ef10-464b-a253-8458410f5409" containerName="test-curl-7645-05fdfa"
Sep 11 12:49:46.584230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584200    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d5e36d-ef10-464b-a253-8458410f5409" containerName="test-curl-7645-05fdfa"
Sep 11 12:49:46.584230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584216    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:49:46.584230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.584227    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:49:46.588396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.588377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.591519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.591496    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c0bbb3\"/\"kube-root-ca.crt\""
Sep 11 12:49:46.591635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.591568    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c0bbb3\"/\"openshift-service-ca.crt\""
Sep 11 12:49:46.592659 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.592636    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c0bbb3\"/\"default-dockercfg-jlqlz\""
Sep 11 12:49:46.592757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.592689    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c0bbb3\"/\"sub-test-model-c0bbb3-kserve-self-signed-certs\""
Sep 11 12:49:46.597587 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.597565    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:49:46.612112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.612085    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:46.734328 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.734513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.734513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr88r\" (UniqueName: \"kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.734513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734463    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.734672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.734672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.734555    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.834997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835057    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835102 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr88r\" (UniqueName: \"kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.835512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.835476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.837339 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.837313    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.837611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.837595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.843712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.843691    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr88r\" (UniqueName: \"kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r\") pod \"sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") " pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:46.898012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:46.897979    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:47.176802 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:47.176770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:49:47.177756 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:49:47.177733    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod633c6dd1_49fb_49af_a7e2_8851855844bc.slice/crio-d864517107f5f548418d67a9e1803cd16c83ba38ef1b1dec97a36d258fec583d WatchSource:0}: Error finding container d864517107f5f548418d67a9e1803cd16c83ba38ef1b1dec97a36d258fec583d: Status 404 returned error can't find the container with id d864517107f5f548418d67a9e1803cd16c83ba38ef1b1dec97a36d258fec583d
Sep 11 12:49:47.955941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:47.955906    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" event={"ID":"633c6dd1-49fb-49af-a7e2-8851855844bc","Type":"ContainerStarted","Data":"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"}
Sep 11 12:49:47.955941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:47.955946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" event={"ID":"633c6dd1-49fb-49af-a7e2-8851855844bc","Type":"ContainerStarted","Data":"d864517107f5f548418d67a9e1803cd16c83ba38ef1b1dec97a36d258fec583d"}
Sep 11 12:49:47.976202 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:47.976155    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" podStartSLOduration=1.9761424440000002 podStartE2EDuration="1.976142444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:49:47.974945408 +0000 UTC m=+1380.618838064" watchObservedRunningTime="2026-09-11 12:49:47.976142444 +0000 UTC m=+1380.620035099"
Sep 11 12:49:48.054610 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:48.054571    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:48.121809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:48.121778    2584 scope.go:117] "RemoveContainer" containerID="98cd16c72bba89f42558ba98e4246e65814e83f490877c067598098601036a36"
Sep 11 12:49:48.132708 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:48.132684    2584 scope.go:117] "RemoveContainer" containerID="625d1332ea7fdb7814bc6913ef65dbf8a77528e2576788d2d641752c2353e8aa"
Sep 11 12:49:48.154804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:48.154720    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:48.698882 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:48.698850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:52.177732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:52.177696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:49:54.548438 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:54.548402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:54.617410 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:54.617360    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:54.701745 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:54.701701    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:54.797211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:54.797176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:49:56.898264 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:56.898231    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:56.898686 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:56.898275    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:56.910454 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:56.910430    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:49:57.017279 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:49:57.017251    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:50:05.227039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:05.226998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:05.459523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:05.459489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:19.177101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:19.177055    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:23.388090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:23.388053    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:50:26.400556 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:26.400526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:30.231217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:30.231164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:32.407208 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:32.407163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:32.507339 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:32.507306    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:32.779943 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:32.779904    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:33.038603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.038507    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:50:33.038990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.038971    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:50:33.038990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.038989    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e051a7-cc43-4d42-a2b3-5db4da5d829c" containerName="istio-proxy"
Sep 11 12:50:33.042397 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.042377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.045254 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.045234    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1e1e43-openshift-default-dockercfg-2rx7r\""
Sep 11 12:50:33.059769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.059737    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:50:33.073582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.073551    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:33.162292 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162665 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhm8\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.162868 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.162785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhm8\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.263788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.263868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.264049    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.264094    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.264115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264442 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.264331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.264531 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.264509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.266563 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.266537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.266766 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.266748    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.272979 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.272954    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.273959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.273936    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhm8\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8\") pod \"e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") " pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.352941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.352856    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:33.557841 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.557803    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:33.636609 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.636578    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:50:33.637637 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:50:33.637615    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f699269_c98c_4dd9_b8ac_4248054bb39a.slice/crio-d167466a35917804251ed2336d61898d735dab377ffa07419792388e3a96e21c WatchSource:0}: Error finding container d167466a35917804251ed2336d61898d735dab377ffa07419792388e3a96e21c: Status 404 returned error can't find the container with id d167466a35917804251ed2336d61898d735dab377ffa07419792388e3a96e21c
Sep 11 12:50:33.640176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.640146    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:33.640267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.640209    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:33.640267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:33.640239    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:34.234277 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:34.234240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerStarted","Data":"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"}
Sep 11 12:50:34.234464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:34.234291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerStarted","Data":"d167466a35917804251ed2336d61898d735dab377ffa07419792388e3a96e21c"}
Sep 11 12:50:34.258711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:34.258662    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podStartSLOduration=1.258646814 podStartE2EDuration="1.258646814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:50:34.255587421 +0000 UTC m=+1426.899480091" watchObservedRunningTime="2026-09-11 12:50:34.258646814 +0000 UTC m=+1426.902539470"
Sep 11 12:50:34.354104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:34.354067    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:34.358812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:34.358783    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:35.240797 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:35.240768    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:35.241711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:35.241691    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:36.181672 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:36.181641    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:36.384733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:36.384699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:37.278764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.278731    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:50:37.282506 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.282487    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.285220 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.285195    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1e1e43-serving-cert\""
Sep 11 12:50:37.292987 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.292964    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:50:37.302631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.302607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.302739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.302650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shfvf\" (UniqueName: \"kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.302739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.302674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.302819 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.302793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.309607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.309581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:37.403730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.403693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.404233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.403745    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shfvf\" (UniqueName: \"kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.404233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.403768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.404233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.403803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.404233 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:50:37.403905    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-serving-cert: secret "maas-api-e2e-api-a-1e1e43-serving-cert" not found
Sep 11 12:50:37.404233 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:50:37.403959    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls podName:e660fb6b-62da-479c-a198-e84f9a8b9057 nodeName:}" failed. No retries permitted until 2026-09-11 12:50:37.903943266 +0000 UTC m=+1430.547835921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls") pod "maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" (UID: "e660fb6b-62da-479c-a198-e84f9a8b9057") : secret "maas-api-e2e-api-a-1e1e43-serving-cert" not found
Sep 11 12:50:37.404583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.404559    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.406308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.406286    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.419114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.418884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:37.419114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.418964    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shfvf\" (UniqueName: \"kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.585717 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.585620    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:37.780571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.780529    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:37.910093 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.909994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.912260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.912237    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") pod \"maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:37.938091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:37.938056    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:38.194865 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:38.194780    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:38.469767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:38.469741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:50:38.470772 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:50:38.470747    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode660fb6b_62da_479c_a198_e84f9a8b9057.slice/crio-8c4c969c0a11a112cd11252216f31aabc76f5b84fe17a27f24c94e4af8634589 WatchSource:0}: Error finding container 8c4c969c0a11a112cd11252216f31aabc76f5b84fe17a27f24c94e4af8634589: Status 404 returned error can't find the container with id 8c4c969c0a11a112cd11252216f31aabc76f5b84fe17a27f24c94e4af8634589
Sep 11 12:50:39.268826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:39.268790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" event={"ID":"e660fb6b-62da-479c-a198-e84f9a8b9057","Type":"ContainerStarted","Data":"8c4c969c0a11a112cd11252216f31aabc76f5b84fe17a27f24c94e4af8634589"}
Sep 11 12:50:40.276378 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:40.276290    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" event={"ID":"e660fb6b-62da-479c-a198-e84f9a8b9057","Type":"ContainerStarted","Data":"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"}
Sep 11 12:50:40.276751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:40.276432    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:40.297477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:40.297432    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" podStartSLOduration=2.437850549 podStartE2EDuration="3.297417895s" totalImagesPullingTime="859.567346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:50:40.295132018 +0000 UTC m=+1432.939024676" watchObservedRunningTime="2026-09-11 12:50:40.297417895 +0000 UTC m=+1432.941310551"
Sep 11 12:50:41.386093 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:41.386054    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:50:41.650478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:41.650382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:50:46.290593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:46.290565    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:50:48.177753 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:48.177722    2584 scope.go:117] "RemoveContainer" containerID="b902e5aae42812014e16a45bebd4aa1cadff12a9988727cedadeeff7f5d73842"
Sep 11 12:50:51.226771 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.226714    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:57138->10.133.0.92:15021: read: connection reset by peer" start-of-body=
Sep 11 12:50:51.227219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.226782    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": read tcp 10.133.0.2:57138->10.133.0.92:15021: read: connection reset by peer"
Sep 11 12:50:51.356203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.356171    2584 generic.go:356] "Generic (PLEG): container finished" podID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerID="4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694" exitCode=0
Sep 11 12:50:51.356361 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.356245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerDied","Data":"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"}
Sep 11 12:50:51.356633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.356618    2584 scope.go:117] "RemoveContainer" containerID="4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"
Sep 11 12:50:51.357741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.357713    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:51.357826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.357777    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:51.357826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:51.357808    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:50:52.364085 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:52.364050    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerStarted","Data":"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"}
Sep 11 12:50:53.353534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:53.353497    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:53.353741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:53.353724    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 12:50:53.353795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:53.353771    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 12:50:54.353814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:54.353773    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 12:50:54.354340 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:54.353849    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 12:50:55.353611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:55.353573    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 12:50:55.353799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:55.353629    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 12:50:56.353583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:56.353549    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 12:50:56.354068 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:56.354019    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 12:50:57.353825 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:57.353786    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 11 12:50:57.354265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:57.353842    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 11 12:50:58.357270 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:58.357235    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:58.357729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:58.357637    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:50:58.358363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:50:58.358342    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:51:01.127583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.127539    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:01.315797 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.315762    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:51:01.633242 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.633207    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:01.922831 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.922733    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:51:01.925988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.925965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:01.929138 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.929117    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1a4a12-openshift-default-dockercfg-lr72g\""
Sep 11 12:51:01.943203 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.943179    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:51:01.971379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:01.971301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:02.054476 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw94z\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.054840 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.054795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw94z\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156436    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.156791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156844    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.156953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.157022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.157226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.157259    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.157363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.157296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.158747 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.158720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.158971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.158954    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.168752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.168728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.170480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.170448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw94z\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z\") pod \"e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") " pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.236566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.236515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:02.411660 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.411616    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:02.537519 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.537492    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:51:02.538395 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:51:02.538367    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60a5d5f_2b36_442f_8fbe_b81793460f8a.slice/crio-6bf5c1b4c841fef4d07c88a64d3d8b26e409f6faca882711865c93a8caa339e0 WatchSource:0}: Error finding container 6bf5c1b4c841fef4d07c88a64d3d8b26e409f6faca882711865c93a8caa339e0: Status 404 returned error can't find the container with id 6bf5c1b4c841fef4d07c88a64d3d8b26e409f6faca882711865c93a8caa339e0
Sep 11 12:51:02.540609 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.540576    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:02.540702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.540641    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:02.540702 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:02.540672    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:03.442249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:03.442209    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerStarted","Data":"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"}
Sep 11 12:51:03.442636 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:03.442270    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerStarted","Data":"6bf5c1b4c841fef4d07c88a64d3d8b26e409f6faca882711865c93a8caa339e0"}
Sep 11 12:51:03.472309 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:03.472258    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podStartSLOduration=2.472241646 podStartE2EDuration="2.472241646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:03.47048675 +0000 UTC m=+1456.114379406" watchObservedRunningTime="2026-09-11 12:51:03.472241646 +0000 UTC m=+1456.116134303"
Sep 11 12:51:04.237121 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:04.237082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:04.242325 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:04.242298    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:04.449095 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:04.449055    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:04.449890 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:04.449871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:05.461894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:05.461858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:05.571666 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:05.571630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:06.653078 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:06.653002    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:06.755815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:06.755776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:07.141761 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:07.141727    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:07.239440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:07.239401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:07.339537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:07.339506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:11.219306 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:11.219267    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:13.417198 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:13.417149    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:14.908115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:14.908076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:15.007795 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:15.007725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:16.142338 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.142302    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7645-6aa05a"]
Sep 11 12:51:16.145221 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.145193    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:16.149269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.149235    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f4fwg\""
Sep 11 12:51:16.151513 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.151491    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-6aa05a"]
Sep 11 12:51:16.203333 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.203296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrqct\" (UniqueName: \"kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct\") pod \"test-curl-7645-6aa05a\" (UID: \"bc2e4008-c0df-4f34-b3bb-65ca42929e3d\") " pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:16.304704 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.304671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrqct\" (UniqueName: \"kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct\") pod \"test-curl-7645-6aa05a\" (UID: \"bc2e4008-c0df-4f34-b3bb-65ca42929e3d\") " pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:16.314487 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.314457    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrqct\" (UniqueName: \"kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct\") pod \"test-curl-7645-6aa05a\" (UID: \"bc2e4008-c0df-4f34-b3bb-65ca42929e3d\") " pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:16.456812 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.456718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:16.735168 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:51:16.735129    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc2e4008_c0df_4f34_b3bb_65ca42929e3d.slice/crio-e1af98362475923ccfe2177bf8f2cfacd928bdef86ac960e5815d250a19fbfd2 WatchSource:0}: Error finding container e1af98362475923ccfe2177bf8f2cfacd928bdef86ac960e5815d250a19fbfd2: Status 404 returned error can't find the container with id e1af98362475923ccfe2177bf8f2cfacd928bdef86ac960e5815d250a19fbfd2
Sep 11 12:51:16.736729 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:16.736698    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-6aa05a"]
Sep 11 12:51:17.566858 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:17.566820    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-6aa05a" event={"ID":"bc2e4008-c0df-4f34-b3bb-65ca42929e3d","Type":"ContainerStarted","Data":"93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b"}
Sep 11 12:51:17.567278 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:17.566869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-6aa05a" event={"ID":"bc2e4008-c0df-4f34-b3bb-65ca42929e3d","Type":"ContainerStarted","Data":"e1af98362475923ccfe2177bf8f2cfacd928bdef86ac960e5815d250a19fbfd2"}
Sep 11 12:51:17.584800 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:17.584753    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7645-6aa05a" podStartSLOduration=1.584739391 podStartE2EDuration="1.584739391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:17.583438984 +0000 UTC m=+1470.227331640" watchObservedRunningTime="2026-09-11 12:51:17.584739391 +0000 UTC m=+1470.228632047"
Sep 11 12:51:18.225858 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.225817    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7645-6aa05a"]
Sep 11 12:51:18.230156 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.230120    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7645-6aa05a"]
Sep 11 12:51:18.350653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.350570    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7645-74762f"]
Sep 11 12:51:18.351051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.351036    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" containerName="test-curl-7645-6aa05a"
Sep 11 12:51:18.351096 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.351054    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" containerName="test-curl-7645-6aa05a"
Sep 11 12:51:18.351136 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.351130    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" containerName="test-curl-7645-6aa05a"
Sep 11 12:51:18.353233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.353211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:18.359607 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.359582    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-74762f"]
Sep 11 12:51:18.442736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.442684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfgj7\" (UniqueName: \"kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7\") pod \"test-curl-7645-74762f\" (UID: \"ed0ac867-13a5-4833-8a51-af6d8ea897ca\") " pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:18.543504 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.543459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgj7\" (UniqueName: \"kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7\") pod \"test-curl-7645-74762f\" (UID: \"ed0ac867-13a5-4833-8a51-af6d8ea897ca\") " pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:18.555862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.555829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgj7\" (UniqueName: \"kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7\") pod \"test-curl-7645-74762f\" (UID: \"ed0ac867-13a5-4833-8a51-af6d8ea897ca\") " pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:18.573134 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:18.573104    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7645-6aa05a" container="test-curl-7645-6aa05a"
Sep 11 12:51:18.665091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.664967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:18.951911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:18.951823    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7645-74762f"]
Sep 11 12:51:18.954970 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:51:18.954940    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded0ac867_13a5_4833_8a51_af6d8ea897ca.slice/crio-c34d830c6a37002c04ec2425ddaa3ec9d8008c3ece7d90697e8223ec95e58b38 WatchSource:0}: Error finding container c34d830c6a37002c04ec2425ddaa3ec9d8008c3ece7d90697e8223ec95e58b38: Status 404 returned error can't find the container with id c34d830c6a37002c04ec2425ddaa3ec9d8008c3ece7d90697e8223ec95e58b38
Sep 11 12:51:19.580039 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:19.579985    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-74762f" event={"ID":"ed0ac867-13a5-4833-8a51-af6d8ea897ca","Type":"ContainerStarted","Data":"990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498"}
Sep 11 12:51:19.580486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:19.580048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7645-74762f" event={"ID":"ed0ac867-13a5-4833-8a51-af6d8ea897ca","Type":"ContainerStarted","Data":"c34d830c6a37002c04ec2425ddaa3ec9d8008c3ece7d90697e8223ec95e58b38"}
Sep 11 12:51:19.580486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:19.580214    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7645-6aa05a" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" containerName="test-curl-7645-6aa05a" containerID="cri-o://93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b" gracePeriod=2
Sep 11 12:51:19.600394 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:19.600361    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7645-6aa05a\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:19.600710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:19.600670    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7645-74762f" podStartSLOduration=1.600656613 podStartE2EDuration="1.600656613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:19.597757665 +0000 UTC m=+1472.241650321" watchObservedRunningTime="2026-09-11 12:51:19.600656613 +0000 UTC m=+1472.244549269"
Sep 11 12:51:20.285566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:20.285485    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7645-74762f"]
Sep 11 12:51:20.290550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:20.290476    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7645-74762f"]
Sep 11 12:51:20.585616 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:20.585538    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7645-74762f" container="test-curl-7645-74762f"
Sep 11 12:51:21.594889 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.594835    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7645-74762f" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" containerName="test-curl-7645-74762f" containerID="cri-o://990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498" gracePeriod=2
Sep 11 12:51:21.598053 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:21.598002    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7645-74762f\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:21.728733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.728707    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:21.731358 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:21.731333    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7645-74762f\" is forbidden: User \"system:node:ip-10-0-143-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-248.ec2.internal' and this object" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:21.786931 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.786894    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrqct\" (UniqueName: \"kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct\") pod \"bc2e4008-c0df-4f34-b3bb-65ca42929e3d\" (UID: \"bc2e4008-c0df-4f34-b3bb-65ca42929e3d\") "
Sep 11 12:51:21.789051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.788997    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct" (OuterVolumeSpecName: "kube-api-access-vrqct") pod "bc2e4008-c0df-4f34-b3bb-65ca42929e3d" (UID: "bc2e4008-c0df-4f34-b3bb-65ca42929e3d"). InnerVolumeSpecName "kube-api-access-vrqct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:21.878725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.878683    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" path="/var/lib/kubelet/pods/bc2e4008-c0df-4f34-b3bb-65ca42929e3d/volumes"
Sep 11 12:51:21.887947 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:21.887926    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrqct\" (UniqueName: \"kubernetes.io/projected/bc2e4008-c0df-4f34-b3bb-65ca42929e3d-kube-api-access-vrqct\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:22.398780 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.398740    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:51:22.410308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.410253    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:22.603496 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.603459    2584 generic.go:356] "Generic (PLEG): container finished" podID="bc2e4008-c0df-4f34-b3bb-65ca42929e3d" containerID="93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b" exitCode=137
Sep 11 12:51:22.603926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.603506    2584 scope.go:117] "RemoveContainer" containerID="93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b"
Sep 11 12:51:22.603926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.603520    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-6aa05a"
Sep 11 12:51:22.614483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.614392    2584 scope.go:117] "RemoveContainer" containerID="93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b"
Sep 11 12:51:22.616144 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:22.616114    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b\": container with ID starting with 93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b not found: ID does not exist" containerID="93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b"
Sep 11 12:51:22.616255 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:22.616155    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b"} err="failed to get container status \"93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b\": rpc error: code = NotFound desc = could not find container \"93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b\": container with ID starting with 93d1c35f56b89e8847f78b7c4f26bcf3e2a0462b8cc7c70f9e083018bc21663b not found: ID does not exist"
Sep 11 12:51:23.618750 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:23.618717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:23.793359 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:23.793332    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:23.909094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:23.908980    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfgj7\" (UniqueName: \"kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7\") pod \"ed0ac867-13a5-4833-8a51-af6d8ea897ca\" (UID: \"ed0ac867-13a5-4833-8a51-af6d8ea897ca\") "
Sep 11 12:51:23.911067 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:23.911038    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7" (OuterVolumeSpecName: "kube-api-access-wfgj7") pod "ed0ac867-13a5-4833-8a51-af6d8ea897ca" (UID: "ed0ac867-13a5-4833-8a51-af6d8ea897ca"). InnerVolumeSpecName "kube-api-access-wfgj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:24.010296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.010262    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfgj7\" (UniqueName: \"kubernetes.io/projected/ed0ac867-13a5-4833-8a51-af6d8ea897ca-kube-api-access-wfgj7\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:24.619388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.619349    2584 generic.go:356] "Generic (PLEG): container finished" podID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" containerID="990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498" exitCode=137
Sep 11 12:51:24.621826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.619400    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7645-74762f"
Sep 11 12:51:24.621826 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.619448    2584 scope.go:117] "RemoveContainer" containerID="990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498"
Sep 11 12:51:24.631668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.631643    2584 scope.go:117] "RemoveContainer" containerID="990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498"
Sep 11 12:51:24.632014 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:24.631992    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498\": container with ID starting with 990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498 not found: ID does not exist" containerID="990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498"
Sep 11 12:51:24.632104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.632021    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498"} err="failed to get container status \"990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498\": rpc error: code = NotFound desc = could not find container \"990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498\": container with ID starting with 990357d03d266659ee4e305493dcc0784e580fb7c6a3fa35c3c5f4f64cc64498 not found: ID does not exist"
Sep 11 12:51:24.838728 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:24.838646    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:25.627905 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.627815    2584 generic.go:356] "Generic (PLEG): container finished" podID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerID="b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e" exitCode=0
Sep 11 12:51:25.628393 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.627894    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerDied","Data":"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"}
Sep 11 12:51:25.628453 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.628423    2584 scope.go:117] "RemoveContainer" containerID="b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"
Sep 11 12:51:25.629667 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.629637    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:25.629763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.629707    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:25.629763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.629738    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:51:25.883593 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:25.883507    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" path="/var/lib/kubelet/pods/ed0ac867-13a5-4833-8a51-af6d8ea897ca/volumes"
Sep 11 12:51:26.637781 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:26.637743    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerStarted","Data":"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"}
Sep 11 12:51:27.237272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:27.237233    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:27.237492 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:27.237361    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:27.237492 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:27.237417    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:27.756741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:27.756703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:28.036244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:28.036135    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:51:28.237971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:28.237930    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:28.238188 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:28.237999    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:29.237206 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:29.237170    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:29.237791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:29.237760    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:30.237507 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:30.237463    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:30.238119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:30.238079    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:30.398933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:30.398891    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:30.768099 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:30.768059    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:31.237684 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:31.237647    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:31.238296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:31.238263    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:32.237090 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:32.237052    2584 patch_prober.go:28] interesting pod/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 11 12:51:32.237270 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:32.237122    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 11 12:51:33.241803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:33.241771    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:33.242267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:33.242062    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:33.242817 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:33.242800    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:51:33.563650 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:33.563567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:37.417969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.417899    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" podUID="633c6dd1-49fb-49af-a7e2-8851855844bc" containerName="main" containerID="cri-o://0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0" gracePeriod=45
Sep 11 12:51:37.675522 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.675458    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:51:37.719466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.719436    2584 generic.go:356] "Generic (PLEG): container finished" podID="633c6dd1-49fb-49af-a7e2-8851855844bc" containerID="0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0" exitCode=0
Sep 11 12:51:37.719632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.719476    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"
Sep 11 12:51:37.719632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.719521    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" event={"ID":"633c6dd1-49fb-49af-a7e2-8851855844bc","Type":"ContainerDied","Data":"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"}
Sep 11 12:51:37.719632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.719571    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp" event={"ID":"633c6dd1-49fb-49af-a7e2-8851855844bc","Type":"ContainerDied","Data":"d864517107f5f548418d67a9e1803cd16c83ba38ef1b1dec97a36d258fec583d"}
Sep 11 12:51:37.719632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.719595    2584 scope.go:117] "RemoveContainer" containerID="0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"
Sep 11 12:51:37.730131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.730111    2584 scope.go:117] "RemoveContainer" containerID="0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"
Sep 11 12:51:37.730487 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:37.730465    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0\": container with ID starting with 0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0 not found: ID does not exist" containerID="0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"
Sep 11 12:51:37.730564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.730494    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0"} err="failed to get container status \"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0\": rpc error: code = NotFound desc = could not find container \"0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0\": container with ID starting with 0246a85fa1f973cf4141efcfa3bb4ea99896e057b9440b520afacff0bfdacae0 not found: ID does not exist"
Sep 11 12:51:37.758583 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758543    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr88r\" (UniqueName: \"kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.758765 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758656    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.758765 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.758765 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758757    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.758932 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758787    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.758932 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.758817    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home\") pod \"633c6dd1-49fb-49af-a7e2-8851855844bc\" (UID: \"633c6dd1-49fb-49af-a7e2-8851855844bc\") "
Sep 11 12:51:37.759064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.759012    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:51:37.759122 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.759061    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:51:37.759186 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.759160    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home" (OuterVolumeSpecName: "home") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:51:37.759247 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.759190    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-tmp-dir\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:37.759247 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.759206    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-model-cache\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:37.760833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.760809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm" (OuterVolumeSpecName: "dshm") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:51:37.761209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.761184    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:51:37.761308 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.761230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r" (OuterVolumeSpecName: "kube-api-access-rr88r") pod "633c6dd1-49fb-49af-a7e2-8851855844bc" (UID: "633c6dd1-49fb-49af-a7e2-8851855844bc"). InnerVolumeSpecName "kube-api-access-rr88r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:37.859687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.859646    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633c6dd1-49fb-49af-a7e2-8851855844bc-tls-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:37.859687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.859680    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-home\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:37.859687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.859689    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr88r\" (UniqueName: \"kubernetes.io/projected/633c6dd1-49fb-49af-a7e2-8851855844bc-kube-api-access-rr88r\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:37.859687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:37.859697    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633c6dd1-49fb-49af-a7e2-8851855844bc-dshm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:38.038447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:38.038414    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:51:38.042947 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:38.042920    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c0bbb3/sub-test-model-c0bbb3-kserve-8588d9df9f-47zjp"]
Sep 11 12:51:39.877234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:39.877201    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633c6dd1-49fb-49af-a7e2-8851855844bc" path="/var/lib/kubelet/pods/633c6dd1-49fb-49af-a7e2-8851855844bc/volumes"
Sep 11 12:51:40.397141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:40.397104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:42.183567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:42.183529    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:43.521375 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:43.521336    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:45.606564 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:45.606527    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:51:48.204440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:48.204411    2584 scope.go:117] "RemoveContainer" containerID="faf6c5289e7bdd28cf56b820a890e788d3c17abef7408d06c31b57d1c3a2525e"
Sep 11 12:51:48.213182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:48.213161    2584 scope.go:117] "RemoveContainer" containerID="fe235cb1596ffa9f6e3bd8676001ffede3949e1bc5f9e440159f6753c02f8211"
Sep 11 12:51:48.221184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:48.221165    2584 scope.go:117] "RemoveContainer" containerID="191a10b8e5e1041a960006736b8c45ba4ce4fd2f2b50a27b24ebca5587c47ef8"
Sep 11 12:51:48.228856 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:48.228840    2584 scope.go:117] "RemoveContainer" containerID="e94736550961eefcd7b50622d15741edc301c2b5f8f53847ab1213d8ac0483eb"
Sep 11 12:51:49.117416 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.117380    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:51:49.117651 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.117612    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" podUID="e660fb6b-62da-479c-a198-e84f9a8b9057" containerName="maas-api" containerID="cri-o://3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5" gracePeriod=30
Sep 11 12:51:49.161735 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.161705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:49.325643 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.325516    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:49.373990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.373938    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:51:49.446282 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.446248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:49.469316 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.469288    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs\") pod \"e660fb6b-62da-479c-a198-e84f9a8b9057\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") "
Sep 11 12:51:49.469461 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.469358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") pod \"e660fb6b-62da-479c-a198-e84f9a8b9057\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") "
Sep 11 12:51:49.469461 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.469384    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shfvf\" (UniqueName: \"kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf\") pod \"e660fb6b-62da-479c-a198-e84f9a8b9057\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") "
Sep 11 12:51:49.469461 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.469451    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca\") pod \"e660fb6b-62da-479c-a198-e84f9a8b9057\" (UID: \"e660fb6b-62da-479c-a198-e84f9a8b9057\") "
Sep 11 12:51:49.469811 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.469786    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e660fb6b-62da-479c-a198-e84f9a8b9057" (UID: "e660fb6b-62da-479c-a198-e84f9a8b9057"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:51:49.471418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.471395    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf" (OuterVolumeSpecName: "kube-api-access-shfvf") pod "e660fb6b-62da-479c-a198-e84f9a8b9057" (UID: "e660fb6b-62da-479c-a198-e84f9a8b9057"). InnerVolumeSpecName "kube-api-access-shfvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:49.471418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.471406    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e660fb6b-62da-479c-a198-e84f9a8b9057" (UID: "e660fb6b-62da-479c-a198-e84f9a8b9057"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:51:49.471540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.471459    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e660fb6b-62da-479c-a198-e84f9a8b9057" (UID: "e660fb6b-62da-479c-a198-e84f9a8b9057"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:51:49.567094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.567056    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:49.571119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.571093    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e660fb6b-62da-479c-a198-e84f9a8b9057-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.571119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.571120    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.571269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.571133    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e660fb6b-62da-479c-a198-e84f9a8b9057-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.571269 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.571144    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shfvf\" (UniqueName: \"kubernetes.io/projected/e660fb6b-62da-479c-a198-e84f9a8b9057-kube-api-access-shfvf\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.668260 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.668175    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:49.795512 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.795479    2584 generic.go:356] "Generic (PLEG): container finished" podID="e660fb6b-62da-479c-a198-e84f9a8b9057" containerID="3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5" exitCode=0
Sep 11 12:51:49.795682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.795531    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"
Sep 11 12:51:49.795682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.795565    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" event={"ID":"e660fb6b-62da-479c-a198-e84f9a8b9057","Type":"ContainerDied","Data":"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"}
Sep 11 12:51:49.795682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.795635    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt" event={"ID":"e660fb6b-62da-479c-a198-e84f9a8b9057","Type":"ContainerDied","Data":"8c4c969c0a11a112cd11252216f31aabc76f5b84fe17a27f24c94e4af8634589"}
Sep 11 12:51:49.795682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.795664    2584 scope.go:117] "RemoveContainer" containerID="3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"
Sep 11 12:51:49.805613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.805595    2584 scope.go:117] "RemoveContainer" containerID="3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"
Sep 11 12:51:49.805834 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:51:49.805818    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5\": container with ID starting with 3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5 not found: ID does not exist" containerID="3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"
Sep 11 12:51:49.805877 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.805842    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5"} err="failed to get container status \"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5\": rpc error: code = NotFound desc = could not find container \"3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5\": container with ID starting with 3ede3307a70e31ab311c5e3cc55154668ad7763f7a0395b4f3a5fd79b6ae23a5 not found: ID does not exist"
Sep 11 12:51:49.821233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.821209    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:51:49.828643 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.828610    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1e1e43-588cbc9496-97ngt"]
Sep 11 12:51:49.877141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.877112    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e660fb6b-62da-479c-a198-e84f9a8b9057" path="/var/lib/kubelet/pods/e660fb6b-62da-479c-a198-e84f9a8b9057/volumes"
Sep 11 12:51:49.939395 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:49.939317    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:57.222894 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:57.222854    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:57.324833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:57.324791    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:57.485219 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:57.485189    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:51:57.485418 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:57.485397    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" containerID="cri-o://60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d" gracePeriod=30
Sep 11 12:51:57.529551 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:57.529517    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:58.024891 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:58.024850    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:51:58.359660 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:58.359585    2584 patch_prober.go:28] interesting pod/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:51:58.359660 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:51:58.359637    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:52:01.795612 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:01.795576    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:52:02.736606 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.736581    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:52:02.789939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.789860    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.789939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.789898    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.789939 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.789926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.789943    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.789967    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790169    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwhm8\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790229 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790186    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:02.790495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790240    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket\") pod \"7f699269-c98c-4dd9-b8ac-4248054bb39a\" (UID: \"7f699269-c98c-4dd9-b8ac-4248054bb39a\") "
Sep 11 12:52:02.790567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790538    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:02.790567 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790552    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:02.790661 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790561    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:02.790746 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790729    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f699269-c98c-4dd9-b8ac-4248054bb39a-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.790806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790755    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.790806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790771    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.790806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790784    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.790806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.790733    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:02.792460 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.792424    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:02.792581 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.792559    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:02.792647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.792559    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:52:02.792829 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.792815    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8" (OuterVolumeSpecName: "kube-api-access-hwhm8") pod "7f699269-c98c-4dd9-b8ac-4248054bb39a" (UID: "7f699269-c98c-4dd9-b8ac-4248054bb39a"). InnerVolumeSpecName "kube-api-access-hwhm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:02.878263 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.878233    2584 generic.go:356] "Generic (PLEG): container finished" podID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerID="60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d" exitCode=0
Sep 11 12:52:02.878631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.878278    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"
Sep 11 12:52:02.878631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.878317    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerDied","Data":"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"}
Sep 11 12:52:02.878631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.878362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps" event={"ID":"7f699269-c98c-4dd9-b8ac-4248054bb39a","Type":"ContainerDied","Data":"d167466a35917804251ed2336d61898d735dab377ffa07419792388e3a96e21c"}
Sep 11 12:52:02.878631 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.878382    2584 scope.go:117] "RemoveContainer" containerID="60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"
Sep 11 12:52:02.888142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.888123    2584 scope.go:117] "RemoveContainer" containerID="4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"
Sep 11 12:52:02.891224 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.891206    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.891304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.891225    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.891304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.891235    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.891304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.891243    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f699269-c98c-4dd9-b8ac-4248054bb39a-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.891304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.891252    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwhm8\" (UniqueName: \"kubernetes.io/projected/7f699269-c98c-4dd9-b8ac-4248054bb39a-kube-api-access-hwhm8\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:02.895806 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.895791    2584 scope.go:117] "RemoveContainer" containerID="60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"
Sep 11 12:52:02.896076 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:52:02.896057    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d\": container with ID starting with 60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d not found: ID does not exist" containerID="60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"
Sep 11 12:52:02.896113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.896084    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d"} err="failed to get container status \"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d\": rpc error: code = NotFound desc = could not find container \"60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d\": container with ID starting with 60b5a07568c93694072f985ae0d29db52714e0bf16c3f7b39057cb85973ea28d not found: ID does not exist"
Sep 11 12:52:02.896113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.896101    2584 scope.go:117] "RemoveContainer" containerID="4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"
Sep 11 12:52:02.896330 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:52:02.896313    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694\": container with ID starting with 4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694 not found: ID does not exist" containerID="4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"
Sep 11 12:52:02.896379 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.896334    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694"} err="failed to get container status \"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694\": rpc error: code = NotFound desc = could not find container \"4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694\": container with ID starting with 4003bee0c39cf1eb20d8b11dcddd377a7c75bf10ad2591ec6184552c1df3d694 not found: ID does not exist"
Sep 11 12:52:02.903244 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.903223    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:52:02.909725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:02.909705    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1e1e43-openshift-default-9c7d85f94-zllps"]
Sep 11 12:52:03.877182 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:03.877148    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" path="/var/lib/kubelet/pods/7f699269-c98c-4dd9-b8ac-4248054bb39a/volumes"
Sep 11 12:52:13.517315 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:13.517221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:13.620623 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:13.620583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:13.704004 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:13.703974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:13.763759 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:13.763723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:14.109205 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:14.109169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:15.779653 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:15.779618    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:19.191990 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:19.191933    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:52:20.370758 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:20.370715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:20.471505 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:20.471470    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:20.609250 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:20.609219    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:52:20.609501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:20.609448    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy" containerID="cri-o://d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb" gracePeriod=30
Sep 11 12:52:20.644903 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:20.644832    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:21.107392 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:21.107359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:25.866294 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.866269    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:52:25.896491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.896434    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.896491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.896464    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.898504 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.898480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:25.898610 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.898520    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:25.996942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.996918    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.996953    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.996979    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.996998    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997016    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997058    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997112    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw94z\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z\") pod \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\" (UID: \"c60a5d5f-2b36-442f-8fbe-b81793460f8a\") "
Sep 11 12:52:25.997447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997218    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:25.997447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997257    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:25.997447 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997367    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:25.997601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997489    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:25.997601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997546    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:25.997601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997570    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:25.997601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997590    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:25.997748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997603    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:25.997748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997617    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:25.997748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.997632    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:25.998896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.998878    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:52:25.999015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:25.998996    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z" (OuterVolumeSpecName: "kube-api-access-fw94z") pod "c60a5d5f-2b36-442f-8fbe-b81793460f8a" (UID: "c60a5d5f-2b36-442f-8fbe-b81793460f8a"). InnerVolumeSpecName "kube-api-access-fw94z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:26.009688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.009660    2584 generic.go:356] "Generic (PLEG): container finished" podID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerID="d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb" exitCode=0
Sep 11 12:52:26.009774 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.009726    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"
Sep 11 12:52:26.009774 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.009735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerDied","Data":"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"}
Sep 11 12:52:26.009850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.009775    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m" event={"ID":"c60a5d5f-2b36-442f-8fbe-b81793460f8a","Type":"ContainerDied","Data":"6bf5c1b4c841fef4d07c88a64d3d8b26e409f6faca882711865c93a8caa339e0"}
Sep 11 12:52:26.009850 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.009795    2584 scope.go:117] "RemoveContainer" containerID="d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"
Sep 11 12:52:26.018777 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.018758    2584 scope.go:117] "RemoveContainer" containerID="b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"
Sep 11 12:52:26.027015 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.027000    2584 scope.go:117] "RemoveContainer" containerID="d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"
Sep 11 12:52:26.027288 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:52:26.027272    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb\": container with ID starting with d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb not found: ID does not exist" containerID="d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"
Sep 11 12:52:26.027342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.027295    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb"} err="failed to get container status \"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb\": rpc error: code = NotFound desc = could not find container \"d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb\": container with ID starting with d861c350f60e45c0b1ca3d30fec4ce38a0ac55a220e675c6586e7b00212e7dbb not found: ID does not exist"
Sep 11 12:52:26.027342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.027311    2584 scope.go:117] "RemoveContainer" containerID="b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"
Sep 11 12:52:26.027565 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:52:26.027548    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e\": container with ID starting with b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e not found: ID does not exist" containerID="b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"
Sep 11 12:52:26.027613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.027570    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e"} err="failed to get container status \"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e\": rpc error: code = NotFound desc = could not find container \"b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e\": container with ID starting with b18dfc9550b6c67cc29c59b0a7dcc9712797f1dbabbb9e39b709bc0849f1da3e not found: ID does not exist"
Sep 11 12:52:26.033712 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.033691    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:52:26.038036 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.038005    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1a4a12-openshift-default-569bcb44bb-9z85m"]
Sep 11 12:52:26.098281 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.098257    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c60a5d5f-2b36-442f-8fbe-b81793460f8a-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:26.098281 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.098279    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:26.098420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.098289    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c60a5d5f-2b36-442f-8fbe-b81793460f8a-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:26.098420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:26.098297    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw94z\" (UniqueName: \"kubernetes.io/projected/c60a5d5f-2b36-442f-8fbe-b81793460f8a-kube-api-access-fw94z\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:27.877441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:27.877403    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" path="/var/lib/kubelet/pods/c60a5d5f-2b36-442f-8fbe-b81793460f8a/volumes"
Sep 11 12:52:29.758241 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:29.758204    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:31.129936 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:31.129906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:31.877508 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:31.877472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:31.976249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:31.976217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:32.079999 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:32.079964    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:32.173087 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:32.172987    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:32.522572 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:32.522534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:34.443052 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:34.443008    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:37.194921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:37.194881    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:52:38.651449 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:38.651388    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:38.751472 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:38.751430    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:38.884002 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:38.883966    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:52:38.884245 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:38.884215    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" containerID="cri-o://45f0340c3e543f733b299a36764854cd7eb7c42d06097c25d9fc3e324f2f0fd7" gracePeriod=30
Sep 11 12:52:38.911995 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:38.911921    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:39.326833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:39.326794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:41.260584 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:41.260548    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:52:41.260935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:41.260604    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:52:44.115897 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.115867    2584 generic.go:356] "Generic (PLEG): container finished" podID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerID="45f0340c3e543f733b299a36764854cd7eb7c42d06097c25d9fc3e324f2f0fd7" exitCode=0
Sep 11 12:52:44.116336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.115938    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerDied","Data":"45f0340c3e543f733b299a36764854cd7eb7c42d06097c25d9fc3e324f2f0fd7"}
Sep 11 12:52:44.116336 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.116009    2584 scope.go:117] "RemoveContainer" containerID="b88351c29d6e831ba251acd22efdbbcd4093758320d2b61ec7a10ab876e07f63"
Sep 11 12:52:44.152155 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.152108    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:52:44.252037 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252009    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252065    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252086    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252121    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252163    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252181 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252181    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252217    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252284    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252316    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8kjr\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr\") pod \"8fe06435-1350-4b01-8069-1acbeb8ca874\" (UID: \"8fe06435-1350-4b01-8069-1acbeb8ca874\") "
Sep 11 12:52:44.252571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252428    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:44.252571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252451    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:44.252571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252470    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:44.252571 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252495    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:44.252818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252767    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fe06435-1350-4b01-8069-1acbeb8ca874-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.252818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252792    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.252818 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252809    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.252997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252822    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.252997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.252834    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:44.254362 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.254338    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:44.254459 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.254364    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:52:44.254501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.254475    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:52:44.254501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.254480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr" (OuterVolumeSpecName: "kube-api-access-t8kjr") pod "8fe06435-1350-4b01-8069-1acbeb8ca874" (UID: "8fe06435-1350-4b01-8069-1acbeb8ca874"). InnerVolumeSpecName "kube-api-access-t8kjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:44.353497 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.353473    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.353497 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.353497    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8kjr\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-kube-api-access-t8kjr\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.353633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.353507    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.353633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.353515    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:44.353633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:44.353523    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fe06435-1350-4b01-8069-1acbeb8ca874-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:45.123480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.123449    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4" event={"ID":"8fe06435-1350-4b01-8069-1acbeb8ca874","Type":"ContainerDied","Data":"eb4260e687271befc280b8e7ee1a205be0262a090ad6de130318c87736452f50"}
Sep 11 12:52:45.123480 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.123480    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"
Sep 11 12:52:45.124040 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.123507    2584 scope.go:117] "RemoveContainer" containerID="45f0340c3e543f733b299a36764854cd7eb7c42d06097c25d9fc3e324f2f0fd7"
Sep 11 12:52:45.146646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.146623    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:52:45.152145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.152126    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-ce2636-openshift-default-7f594568f6-xz5x4"]
Sep 11 12:52:45.877490 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:45.877455    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" path="/var/lib/kubelet/pods/8fe06435-1350-4b01-8069-1acbeb8ca874/volumes"
Sep 11 12:52:47.414763 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:47.414726    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:47.515303 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:47.515271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:47.902537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:47.902503    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:52:49.751656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.751621    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:52:49.752135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.751863    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" podUID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" containerName="maas-api" containerID="cri-o://110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d" gracePeriod=30
Sep 11 12:52:49.790971 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.790935    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:49.872646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.872612    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:49.934474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.934394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:49.990553 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:49.990527    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:52:50.005969 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.005917    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:50.096330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.096306    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") pod \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") "
Sep 11 12:52:50.096451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.096356    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs\") pod \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") "
Sep 11 12:52:50.096451 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.096392    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca\") pod \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") "
Sep 11 12:52:50.096534 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.096468    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftfwr\" (UniqueName: \"kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr\") pod \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\" (UID: \"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5\") "
Sep 11 12:52:50.096853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.096825    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" (UID: "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:50.098536 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.098517    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr" (OuterVolumeSpecName: "kube-api-access-ftfwr") pod "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" (UID: "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5"). InnerVolumeSpecName "kube-api-access-ftfwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:50.098779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.098765    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" (UID: "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:50.098823 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.098795    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" (UID: "2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:50.155816 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.155785    2584 generic.go:356] "Generic (PLEG): container finished" podID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" containerID="110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d" exitCode=0
Sep 11 12:52:50.155977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.155828    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"
Sep 11 12:52:50.155977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.155868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" event={"ID":"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5","Type":"ContainerDied","Data":"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"}
Sep 11 12:52:50.155977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.155935    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr" event={"ID":"2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5","Type":"ContainerDied","Data":"43736261b0080b2b19d3a8a5106f9f812108f8deccc3f11eb5fa648f2fb1a57b"}
Sep 11 12:52:50.155977 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.155970    2584 scope.go:117] "RemoveContainer" containerID="110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"
Sep 11 12:52:50.166962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.166944    2584 scope.go:117] "RemoveContainer" containerID="110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"
Sep 11 12:52:50.167332 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:52:50.167314    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d\": container with ID starting with 110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d not found: ID does not exist" containerID="110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"
Sep 11 12:52:50.167407 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.167341    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d"} err="failed to get container status \"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d\": rpc error: code = NotFound desc = could not find container \"110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d\": container with ID starting with 110fe17e6cb1782033636c9e42883784eea04d1f4d09ef0f0b056fdce3b0e22d not found: ID does not exist"
Sep 11 12:52:50.188750 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.188715    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:52:50.197972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.197944    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:50.197972 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.197968    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:50.198159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.197979    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftfwr\" (UniqueName: \"kubernetes.io/projected/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-kube-api-access-ftfwr\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:50.198159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.197988    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:52:50.198809 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.198785    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5db8fe-558975b68c-q6blr"]
Sep 11 12:52:50.349233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:50.349137    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:51.877298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:51.877265    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" path="/var/lib/kubelet/pods/2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5/volumes"
Sep 11 12:52:56.222050 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:56.221997    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:56.325210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:56.325170    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:52:56.434145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:56.434110    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:52:56.434417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:56.434371    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy" containerID="cri-o://273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c" gracePeriod=30
Sep 11 12:52:56.462295 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:52:56.462270    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:00.982868 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:00.982835    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:53:01.691941 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.691915    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:53:01.798231 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798178    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798247    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798302    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798384    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wvbp\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798431 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798415    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798448    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798520    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data" (OuterVolumeSpecName: "istio-data") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:01.798652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798543    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798652 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798587    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert\") pod \"31f9941e-441b-44b0-be41-af76a14b3da9\" (UID: \"31f9941e-441b-44b0-be41-af76a14b3da9\") "
Sep 11 12:53:01.798911 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798723    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:01.798994 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.798958    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:01.799207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.799156    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:01.799207 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.799164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:53:01.799500 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.799439    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.799500 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.799470    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.801218 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.801181    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:53:01.801305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.801210    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp" (OuterVolumeSpecName: "kube-api-access-8wvbp") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "kube-api-access-8wvbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:01.801445 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.801423    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:53:01.801682 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.801652    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token" (OuterVolumeSpecName: "istio-token") pod "31f9941e-441b-44b0-be41-af76a14b3da9" (UID: "31f9941e-441b-44b0-be41-af76a14b3da9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:53:01.900424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900398    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900419    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31f9941e-441b-44b0-be41-af76a14b3da9-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900424 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900428    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900436    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31f9941e-441b-44b0-be41-af76a14b3da9-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900444    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wvbp\" (UniqueName: \"kubernetes.io/projected/31f9941e-441b-44b0-be41-af76a14b3da9-kube-api-access-8wvbp\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900454    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:01.900625 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:01.900463    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31f9941e-441b-44b0-be41-af76a14b3da9-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:53:02.222910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.222819    2584 generic.go:356] "Generic (PLEG): container finished" podID="31f9941e-441b-44b0-be41-af76a14b3da9" containerID="273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c" exitCode=0
Sep 11 12:53:02.222910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.222875    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"
Sep 11 12:53:02.223409 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.222906    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerDied","Data":"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"}
Sep 11 12:53:02.223409 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.222968    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp" event={"ID":"31f9941e-441b-44b0-be41-af76a14b3da9","Type":"ContainerDied","Data":"2232c152c37b9e5cc800ef038bff8ea67032845f3b7d5fa90bfb0787038f9228"}
Sep 11 12:53:02.223409 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.222991    2584 scope.go:117] "RemoveContainer" containerID="273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"
Sep 11 12:53:02.233743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.233713    2584 scope.go:117] "RemoveContainer" containerID="9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"
Sep 11 12:53:02.242498 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.242476    2584 scope.go:117] "RemoveContainer" containerID="273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"
Sep 11 12:53:02.242813 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:53:02.242786    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c\": container with ID starting with 273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c not found: ID does not exist" containerID="273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"
Sep 11 12:53:02.242877 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.242826    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c"} err="failed to get container status \"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c\": rpc error: code = NotFound desc = could not find container \"273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c\": container with ID starting with 273d1f20bf062b8d5382ca355f20eac77d7d9102017c4d67b6e173f9f44ee16c not found: ID does not exist"
Sep 11 12:53:02.242877 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.242851    2584 scope.go:117] "RemoveContainer" containerID="9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"
Sep 11 12:53:02.242983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.242878    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:53:02.243166 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:53:02.243150    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a\": container with ID starting with 9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a not found: ID does not exist" containerID="9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"
Sep 11 12:53:02.243234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.243173    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a"} err="failed to get container status \"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a\": rpc error: code = NotFound desc = could not find container \"9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a\": container with ID starting with 9d87fa0e583c22926f8644215466ffe147dc1bebb542858ae7bc68727228485a not found: ID does not exist"
Sep 11 12:53:02.246420 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:02.246395    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-5db8fe-openshift-default-86885d6744-dxjdp"]
Sep 11 12:53:03.877772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:03.877737    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" path="/var/lib/kubelet/pods/31f9941e-441b-44b0-be41-af76a14b3da9/volumes"
Sep 11 12:53:07.027739 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:07.027699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:07.888918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:07.888889    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:08.317262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.317229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:08.717814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.717737    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:53:08.718160 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718146    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633c6dd1-49fb-49af-a7e2-8851855844bc" containerName="main"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718161    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="633c6dd1-49fb-49af-a7e2-8851855844bc" containerName="main"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718174    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718181    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718194    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e660fb6b-62da-479c-a198-e84f9a8b9057" containerName="maas-api"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718199    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e660fb6b-62da-479c-a198-e84f9a8b9057" containerName="maas-api"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718206    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718211    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718217    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.718222 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718222    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718230    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718236    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718242    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" containerName="test-curl-7645-74762f"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718247    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" containerName="test-curl-7645-74762f"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718253    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718259    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718266    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718271    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718277    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" containerName="maas-api"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718282    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" containerName="maas-api"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718288    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718293    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718338    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718346    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718353    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718360    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60a5d5f-2b36-442f-8fbe-b81793460f8a" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718365    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718370    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718374    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e660fb6b-62da-479c-a198-e84f9a8b9057" containerName="maas-api"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718379    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0ac867-13a5-4833-8a51-af6d8ea897ca" containerName="test-curl-7645-74762f"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718384    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="633c6dd1-49fb-49af-a7e2-8851855844bc" containerName="main"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718390    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2cfc1f-e6e2-44a9-adc1-4dfb542bfee5" containerName="maas-api"
Sep 11 12:53:08.718516 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.718395    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe06435-1350-4b01-8069-1acbeb8ca874" containerName="istio-proxy"
Sep 11 12:53:08.722912 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.722892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.726874 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.726854    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c689a2-openshift-default-dockercfg-djvhm\""
Sep 11 12:53:08.730871 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.730834    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:08.749603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.749575    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:53:08.864921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.864888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.864921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.864921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.864939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.864969    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsplc\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.865014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.865067    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.865086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.865154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.865302 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.865206    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.889338 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.889304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:08.966550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966518    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966690    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966782 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsplc\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.966983 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.966825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.967111 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.967052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.967167 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.967141    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.967228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.967197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.967362 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.967342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.967422 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.967400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.968908 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.968857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.969107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.969090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.976216 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.976194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsplc\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:08.976305 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:08.976222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token\") pod \"e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") " pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:09.034228 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:09.034207    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:09.311071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:09.311039    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:53:09.311204 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:53:09.311066    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011ddc3c_705a_4b77_88fd_90c31ae83c77.slice/crio-9094a222a3c20a8069f5c89ff0ddc58b94d34fcbe93dfb10b460867cb5a8dfc9 WatchSource:0}: Error finding container 9094a222a3c20a8069f5c89ff0ddc58b94d34fcbe93dfb10b460867cb5a8dfc9: Status 404 returned error can't find the container with id 9094a222a3c20a8069f5c89ff0ddc58b94d34fcbe93dfb10b460867cb5a8dfc9
Sep 11 12:53:09.313307 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:09.313269    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:09.313384 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:09.313348    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:09.313423 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:09.313388    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:10.268582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:10.268548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerStarted","Data":"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"}
Sep 11 12:53:10.268955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:10.268632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerStarted","Data":"9094a222a3c20a8069f5c89ff0ddc58b94d34fcbe93dfb10b460867cb5a8dfc9"}
Sep 11 12:53:10.292494 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:10.292446    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podStartSLOduration=2.29243139 podStartE2EDuration="2.29243139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:10.290898188 +0000 UTC m=+1582.934790844" watchObservedRunningTime="2026-09-11 12:53:10.29243139 +0000 UTC m=+1582.936324117"
Sep 11 12:53:10.791984 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:10.791953    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:53:11.035261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:11.035226    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:11.040337 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:11.040312    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:11.273752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:11.273724    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:11.274575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:11.274555    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:12.187832 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:12.187794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:12.278151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:12.278121    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:13.397398 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.397363    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:53:13.397935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.397874    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:13.397935 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.397902    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f9941e-441b-44b0-be41-af76a14b3da9" containerName="istio-proxy"
Sep 11 12:53:13.398098 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.397985    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f699269-c98c-4dd9-b8ac-4248054bb39a" containerName="istio-proxy"
Sep 11 12:53:13.401185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.401163    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.405465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.405139    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-c689a2-serving-cert\""
Sep 11 12:53:13.405465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.405180    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:53:13.405465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.405232    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 12:53:13.405465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.405240    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v6tqs\""
Sep 11 12:53:13.405465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.405181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 12:53:13.412875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.412839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:53:13.437344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.437320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:13.506364 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.506341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.506475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.506405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.506475 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.506461    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5jb\" (UniqueName: \"kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.506554 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.506495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.539659 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.539627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:13.607638 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.607610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.607767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.607660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.607767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.607694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5jb\" (UniqueName: \"kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.607767 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.607716    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.607767 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:53:13.607758    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-serving-cert: secret "maas-api-e2e-ipp-a-c689a2-serving-cert" not found
Sep 11 12:53:13.607912 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:53:13.607810    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls podName:9ed2e92d-5a95-4b29-b6ba-51099d5520c1 nodeName:}" failed. No retries permitted until 2026-09-11 12:53:14.107796405 +0000 UTC m=+1586.751689040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls") pod "maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" (UID: "9ed2e92d-5a95-4b29-b6ba-51099d5520c1") : secret "maas-api-e2e-ipp-a-c689a2-serving-cert" not found
Sep 11 12:53:13.608427 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.608407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.610145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.610117    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.616395 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.616376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5jb\" (UniqueName: \"kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:13.713882 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.713787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:13.899854 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.899814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:13.987611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:13.987579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:14.112454 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:14.112425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:14.114934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:14.114904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:14.315320 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:14.315229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:14.591933 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:14.591905    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:53:14.596542 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:53:14.593942    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed2e92d_5a95_4b29_b6ba_51099d5520c1.slice/crio-2666c42c9c0c7796f2a1b501d062513d43372bd52fd40500a812c16d1aaaf293 WatchSource:0}: Error finding container 2666c42c9c0c7796f2a1b501d062513d43372bd52fd40500a812c16d1aaaf293: Status 404 returned error can't find the container with id 2666c42c9c0c7796f2a1b501d062513d43372bd52fd40500a812c16d1aaaf293
Sep 11 12:53:14.596542 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:14.595963    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:53:15.296803 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:15.296764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" event={"ID":"9ed2e92d-5a95-4b29-b6ba-51099d5520c1","Type":"ContainerStarted","Data":"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"}
Sep 11 12:53:15.296942 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:15.296825    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" event={"ID":"9ed2e92d-5a95-4b29-b6ba-51099d5520c1","Type":"ContainerStarted","Data":"2666c42c9c0c7796f2a1b501d062513d43372bd52fd40500a812c16d1aaaf293"}
Sep 11 12:53:15.296997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:15.296954    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:15.317298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:15.317231    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" podStartSLOduration=1.816100204 podStartE2EDuration="2.317215997s" totalImagesPullingTime="501.115793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:15.315116607 +0000 UTC m=+1587.959009258" watchObservedRunningTime="2026-09-11 12:53:15.317215997 +0000 UTC m=+1587.961108653"
Sep 11 12:53:21.307414 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:21.307384    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:53:23.086175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:23.086141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:53:26.626488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:26.626433    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": read tcp 10.133.0.2:33852->10.133.0.97:15021: read: connection reset by peer" start-of-body=
Sep 11 12:53:26.626843 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:26.626498    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": read tcp 10.133.0.2:33852->10.133.0.97:15021: read: connection reset by peer"
Sep 11 12:53:27.402529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.402495    2584 generic.go:356] "Generic (PLEG): container finished" podID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerID="acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c" exitCode=0
Sep 11 12:53:27.402710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.402568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerDied","Data":"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"}
Sep 11 12:53:27.402970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.402957    2584 scope.go:117] "RemoveContainer" containerID="acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"
Sep 11 12:53:27.404012 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.403984    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:27.404136 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.404108    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:27.404200 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:27.404160    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:28.409751 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:28.409711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerStarted","Data":"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"}
Sep 11 12:53:29.034924 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:29.034876    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:29.035159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:29.035015    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Sep 11 12:53:29.035159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:29.035119    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Sep 11 12:53:30.035488 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:30.035447    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Sep 11 12:53:30.036107 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:30.036070    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Sep 11 12:53:31.035414 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:31.035374    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Sep 11 12:53:31.035733 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:31.035703    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Sep 11 12:53:32.035347 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:32.035307    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Sep 11 12:53:32.035558 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:32.035376    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Sep 11 12:53:33.035210 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:33.035164    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused" start-of-body=
Sep 11 12:53:33.035718 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:33.035239    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.97:15021/healthz/ready\": dial tcp 10.133.0.97:15021: connect: connection refused"
Sep 11 12:53:34.038546 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:34.038512    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:34.038910 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:34.038760    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:34.039500 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:34.039480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:53:37.160541 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:37.160502    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:37.804165 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:37.804125    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:38.074287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.074192    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:53:38.081206 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.081182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.083846 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.083824    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c5dca3-openshift-default-dockercfg-tnjf2\""
Sep 11 12:53:38.091671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.091647    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:53:38.101417 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.101391    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:38.117314 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117416 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117412    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117465 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117482    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117550 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.117671 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.117617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbsb\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.218898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.218861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.218898 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.218899    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbsb\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.218938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219643    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219732 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.219893 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.219877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.221245 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.221228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.221810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.221793    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.228120 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.228100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.228537 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.228517    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbsb\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb\") pod \"e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") " pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.392582 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.392498    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:38.623676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.623640    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:38.667386 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.667360    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:53:38.668345 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:53:38.668319    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d44e93_cc21_4f61_b5ad_9ad7df25f9e4.slice/crio-6cb9fb2073bfc6b3447df119fe09dfdebac681faba71a1f3e57064c364a9696a WatchSource:0}: Error finding container 6cb9fb2073bfc6b3447df119fe09dfdebac681faba71a1f3e57064c364a9696a: Status 404 returned error can't find the container with id 6cb9fb2073bfc6b3447df119fe09dfdebac681faba71a1f3e57064c364a9696a
Sep 11 12:53:38.670620 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.670584    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:38.670688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.670671    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:38.670725 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:38.670712    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:39.485113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:39.485079    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerStarted","Data":"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"}
Sep 11 12:53:39.485484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:39.485130    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerStarted","Data":"6cb9fb2073bfc6b3447df119fe09dfdebac681faba71a1f3e57064c364a9696a"}
Sep 11 12:53:39.505683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:39.505634    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podStartSLOduration=1.505609814 podStartE2EDuration="1.505609814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:39.505464314 +0000 UTC m=+1612.149356985" watchObservedRunningTime="2026-09-11 12:53:39.505609814 +0000 UTC m=+1612.149502470"
Sep 11 12:53:40.393679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:40.393641    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:40.398495 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:40.398469    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:40.491113 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:40.491083    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:40.492212 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:40.492194    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:53:41.410683 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:41.410637    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:41.506388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:41.506352    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:42.495730 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.495697    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:53:42.498115 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.498092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.501159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.501138    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-c5dca3-serving-cert\""
Sep 11 12:53:42.515196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.515166    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:53:42.540846 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.540810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:42.557757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.557728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.557757 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.557757    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.557997 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.557974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h8js\" (UniqueName: \"kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.558086 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.558024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.633395 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.633361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:42.658764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.658732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h8js\" (UniqueName: \"kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.658926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.658771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.658926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.658829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.658926 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.658844    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.659502 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.659473    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.661390 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.661366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.661483 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.661389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.667322 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.667304    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h8js\" (UniqueName: \"kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js\") pod \"maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:42.813963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:42.813878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:43.002349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.002315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:43.087744 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.087721    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:53:43.089317 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:53:43.089290    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3650b043_04c7_4916_821a_3317fa7366eb.slice/crio-4ba436b677a4c19fe18194c392b4e5eef1128f45eb516a41993fbeb252b83475 WatchSource:0}: Error finding container 4ba436b677a4c19fe18194c392b4e5eef1128f45eb516a41993fbeb252b83475: Status 404 returned error can't find the container with id 4ba436b677a4c19fe18194c392b4e5eef1128f45eb516a41993fbeb252b83475
Sep 11 12:53:43.090511 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.090469    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:53:43.514566 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.514534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" event={"ID":"3650b043-04c7-4916-821a-3317fa7366eb","Type":"ContainerStarted","Data":"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"}
Sep 11 12:53:43.514716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.514590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" event={"ID":"3650b043-04c7-4916-821a-3317fa7366eb","Type":"ContainerStarted","Data":"4ba436b677a4c19fe18194c392b4e5eef1128f45eb516a41993fbeb252b83475"}
Sep 11 12:53:43.514716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.514618    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:43.535595 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:43.535541    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" podStartSLOduration=1.213131054 podStartE2EDuration="1.535524712s" totalImagesPullingTime="322.393658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:43.533858597 +0000 UTC m=+1616.177751255" watchObservedRunningTime="2026-09-11 12:53:43.535524712 +0000 UTC m=+1616.179417370"
Sep 11 12:53:48.679504 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:48.679424    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:53:49.526153 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:49.526123    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:53:56.533185 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:56.533141    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:53:56.533578 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:56.533198    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:53:58.615104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.615071    2584 generic.go:356] "Generic (PLEG): container finished" podID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerID="ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199" exitCode=0
Sep 11 12:53:58.615529 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.615154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerDied","Data":"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"}
Sep 11 12:53:58.615592 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.615576    2584 scope.go:117] "RemoveContainer" containerID="ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"
Sep 11 12:53:58.616659 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.616631    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:58.616715 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.616702    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:58.616752 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:58.616736    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:53:59.622525 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:53:59.622491    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerStarted","Data":"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"}
Sep 11 12:54:00.393456 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:00.393418    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:54:00.393632 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:00.393583    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 12:54:00.393677 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:00.393635    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 12:54:01.393248 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:01.393210    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 12:54:01.393670 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:01.393267    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 12:54:02.393741 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:02.393701    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 12:54:02.394189 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:02.393776    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 12:54:03.392882 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:03.392846    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 12:54:03.393071 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:03.392913    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 12:54:04.393083 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:04.393045    2584 patch_prober.go:28] interesting pod/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused" start-of-body=
Sep 11 12:54:04.393478 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:04.393104    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.99:15021/healthz/ready\": dial tcp 10.133.0.99:15021: connect: connection refused"
Sep 11 12:54:05.396209 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:05.396175    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:54:05.396603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:05.396427    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:54:05.397217 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:05.397196    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:54:06.357798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:06.357766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:16.903414 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:16.903371    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:20.687748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:20.687711    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:54:35.406954 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:35.406925    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:54:42.416820 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.416778    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:42.683425 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.683353    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:54:42.687243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.687224    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.689902 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.689872    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-96a7d1-openshift-default-dockercfg-4fpbg\""
Sep 11 12:54:42.698413 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.698390    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:54:42.720312 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.720285    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:42.791918 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.791866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792233 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792579 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792720 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792867 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.792985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.792970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fhz\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.793147 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.793130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.793258 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.793246    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.826101 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.826065    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:42.894833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.894991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fhz\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.894991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.894991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.894991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.894991 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895256 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.894998    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895256 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895256 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895406 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895406 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895322    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.895779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.895757    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.897380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.897351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.897586 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.897569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.902919 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.902892    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.903175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.903151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fhz\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz\") pod \"e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") " pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:42.998267 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:42.998233    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:43.278749 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.278726    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:54:43.280421 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:54:43.280391    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2246d40a_0578_4637_a909_cff418acb29d.slice/crio-760c3fd1dcd3fc80dea8f50d3cc727db38ff2a4c2941361c4d0e2ea27e9a3efa WatchSource:0}: Error finding container 760c3fd1dcd3fc80dea8f50d3cc727db38ff2a4c2941361c4d0e2ea27e9a3efa: Status 404 returned error can't find the container with id 760c3fd1dcd3fc80dea8f50d3cc727db38ff2a4c2941361c4d0e2ea27e9a3efa
Sep 11 12:54:43.282769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.282734    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:54:43.282862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.282820    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:54:43.282904 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.282860    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:54:43.883352 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.883316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerStarted","Data":"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"}
Sep 11 12:54:43.883743 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.883370    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerStarted","Data":"760c3fd1dcd3fc80dea8f50d3cc727db38ff2a4c2941361c4d0e2ea27e9a3efa"}
Sep 11 12:54:43.911082 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.911024    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podStartSLOduration=1.911009136 podStartE2EDuration="1.911009136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:54:43.908876669 +0000 UTC m=+1676.552769349" watchObservedRunningTime="2026-09-11 12:54:43.911009136 +0000 UTC m=+1676.554901792"
Sep 11 12:54:43.998324 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:43.998301    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:45.003980 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:45.003952    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:45.786750 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:45.786715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:45.875788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:45.875749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:45.894772 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:45.894738    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:45.896124 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:45.896103    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:54:46.924440 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:46.924401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:47.039388 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:47.039347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:47.184175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:47.184070    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:47.441007 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:47.440918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:47.539501 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:47.539454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:54:51.187798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:54:51.187763    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:55:00.896234 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.896199    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 11 12:55:00.896647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.896261    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 11 12:55:00.994496 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.994464    2584 generic.go:356] "Generic (PLEG): container finished" podID="2246d40a-0578-4637-a909-cff418acb29d" containerID="2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c" exitCode=0
Sep 11 12:55:00.994637 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.994521    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerDied","Data":"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"}
Sep 11 12:55:00.994879 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.994858    2584 scope.go:117] "RemoveContainer" containerID="2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"
Sep 11 12:55:00.995966 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.995934    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:55:00.996099 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.996043    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:55:00.996176 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:00.996096    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:55:02.003174 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:02.003139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerStarted","Data":"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"}
Sep 11 12:55:02.999280 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:02.999241    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:02.999469 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:02.999394    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 11 12:55:02.999469 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:02.999450    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 11 12:55:03.998959 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:03.998914    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 11 12:55:03.999462 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:03.998978    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 11 12:55:04.999342 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:04.999305    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 11 12:55:04.999807 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:04.999366    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 11 12:55:05.999080 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:05.999047    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 11 12:55:05.999288 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:05.999098    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 11 12:55:07.002903 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:07.002867    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:07.003377 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:07.003143    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:07.003699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:07.003682    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:10.770062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:10.769959    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:17.548845 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:17.548806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:17.629640 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:17.629595    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:17.709287 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:17.709258    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:17.774521 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:17.774488    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:18.123212 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:18.123173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:21.878711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:21.878672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:55:24.220114 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:24.220081    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:24.320530 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:24.320495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:24.459805 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:24.459771    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:55:24.460382 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:24.460328    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy" containerID="cri-o://8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b" gracePeriod=30
Sep 11 12:55:24.480466 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:24.480396    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:28.316157 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:28.316119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:29.715441 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.715416    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:29.825330 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825373    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825429    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825491 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825458    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825508    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825536    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2fhz\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825553    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825566    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825572    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825646 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825624    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825651    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token\") pod \"2246d40a-0578-4637-a909-cff418acb29d\" (UID: \"2246d40a-0578-4637-a909-cff418acb29d\") "
Sep 11 12:55:29.825996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.825996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825831    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:29.825996 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.825971    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.826213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.826162    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2246d40a-0578-4637-a909-cff418acb29d-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.826213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.826184    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.826213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.826200    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.826213 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.826212    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.826402 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.826225    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.828018 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.827994    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz" (OuterVolumeSpecName: "kube-api-access-m2fhz") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "kube-api-access-m2fhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:29.828323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.828291    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:29.828433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.828341    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:55:29.828433 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.828390    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2246d40a-0578-4637-a909-cff418acb29d" (UID: "2246d40a-0578-4637-a909-cff418acb29d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:55:29.926884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.926865    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2246d40a-0578-4637-a909-cff418acb29d-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.926884 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.926884    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2fhz\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-kube-api-access-m2fhz\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.927044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.926894    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2246d40a-0578-4637-a909-cff418acb29d-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:29.927044 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:29.926902    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2246d40a-0578-4637-a909-cff418acb29d-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:30.176065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.174813    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerDied","Data":"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"}
Sep 11 12:55:30.176065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.174735    2584 generic.go:356] "Generic (PLEG): container finished" podID="2246d40a-0578-4637-a909-cff418acb29d" containerID="8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b" exitCode=0
Sep 11 12:55:30.176065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.175154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p" event={"ID":"2246d40a-0578-4637-a909-cff418acb29d","Type":"ContainerDied","Data":"760c3fd1dcd3fc80dea8f50d3cc727db38ff2a4c2941361c4d0e2ea27e9a3efa"}
Sep 11 12:55:30.176065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.175173    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"
Sep 11 12:55:30.176065 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.175207    2584 scope.go:117] "RemoveContainer" containerID="8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"
Sep 11 12:55:30.189866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.189851    2584 scope.go:117] "RemoveContainer" containerID="2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"
Sep 11 12:55:30.197781 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.197757    2584 scope.go:117] "RemoveContainer" containerID="8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"
Sep 11 12:55:30.198171 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:55:30.198111    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b\": container with ID starting with 8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b not found: ID does not exist" containerID="8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"
Sep 11 12:55:30.198171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.198146    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b"} err="failed to get container status \"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b\": rpc error: code = NotFound desc = could not find container \"8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b\": container with ID starting with 8a86adcbffb623d064b92155032d89e518219a3aef4cd083bb53a609202e4f5b not found: ID does not exist"
Sep 11 12:55:30.198171 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.198167    2584 scope.go:117] "RemoveContainer" containerID="2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"
Sep 11 12:55:30.198457 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:55:30.198438    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c\": container with ID starting with 2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c not found: ID does not exist" containerID="2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"
Sep 11 12:55:30.198503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.198468    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c"} err="failed to get container status \"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c\": rpc error: code = NotFound desc = could not find container \"2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c\": container with ID starting with 2c06bf99bb86b2dd9bab1f6476939bcae151dcdb6a920750279842a5100f1b6c not found: ID does not exist"
Sep 11 12:55:30.200706 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.200687    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:55:30.204494 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:30.204475    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-96a7d1-openshift-default-58777b86c6-nkm5p"]
Sep 11 12:55:31.814614 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:31.814581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:31.876787 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:31.876755    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2246d40a-0578-4637-a909-cff418acb29d" path="/var/lib/kubelet/pods/2246d40a-0578-4637-a909-cff418acb29d/volumes"
Sep 11 12:55:31.916008 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:31.915985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:41.484791 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:41.484755    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:55:43.658711 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.658678    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:55:43.659249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.658935    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" podUID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" containerName="maas-api" containerID="cri-o://0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e" gracePeriod=30
Sep 11 12:55:43.689464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.689439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:43.810654 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.810617    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:43.910916 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.910847    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:43.912370 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.912353    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:55:43.992778 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:43.992745    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:44.047644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.047617    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca\") pod \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") "
Sep 11 12:55:44.047814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.047663    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z5jb\" (UniqueName: \"kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb\") pod \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") "
Sep 11 12:55:44.047814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.047714    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") pod \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") "
Sep 11 12:55:44.047814 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.047753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs\") pod \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\" (UID: \"9ed2e92d-5a95-4b29-b6ba-51099d5520c1\") "
Sep 11 12:55:44.048059 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.047998    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ed2e92d-5a95-4b29-b6ba-51099d5520c1" (UID: "9ed2e92d-5a95-4b29-b6ba-51099d5520c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:44.050151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.050108    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb" (OuterVolumeSpecName: "kube-api-access-2z5jb") pod "9ed2e92d-5a95-4b29-b6ba-51099d5520c1" (UID: "9ed2e92d-5a95-4b29-b6ba-51099d5520c1"). InnerVolumeSpecName "kube-api-access-2z5jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:44.050151 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.050142    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ed2e92d-5a95-4b29-b6ba-51099d5520c1" (UID: "9ed2e92d-5a95-4b29-b6ba-51099d5520c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:55:44.050799 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.050758    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9ed2e92d-5a95-4b29-b6ba-51099d5520c1" (UID: "9ed2e92d-5a95-4b29-b6ba-51099d5520c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:55:44.148710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.148667    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.148710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.148706    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.148710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.148716    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.148710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.148726    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z5jb\" (UniqueName: \"kubernetes.io/projected/9ed2e92d-5a95-4b29-b6ba-51099d5520c1-kube-api-access-2z5jb\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.260439 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.260412    2584 generic.go:356] "Generic (PLEG): container finished" podID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" containerID="0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e" exitCode=0
Sep 11 12:55:44.260601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.260449    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" event={"ID":"9ed2e92d-5a95-4b29-b6ba-51099d5520c1","Type":"ContainerDied","Data":"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"}
Sep 11 12:55:44.260601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.260466    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"
Sep 11 12:55:44.260601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.260518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49" event={"ID":"9ed2e92d-5a95-4b29-b6ba-51099d5520c1","Type":"ContainerDied","Data":"2666c42c9c0c7796f2a1b501d062513d43372bd52fd40500a812c16d1aaaf293"}
Sep 11 12:55:44.260601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.260540    2584 scope.go:117] "RemoveContainer" containerID="0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"
Sep 11 12:55:44.269920 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.269909    2584 scope.go:117] "RemoveContainer" containerID="0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"
Sep 11 12:55:44.270200 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:55:44.270180    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e\": container with ID starting with 0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e not found: ID does not exist" containerID="0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"
Sep 11 12:55:44.270272 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.270207    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e"} err="failed to get container status \"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e\": rpc error: code = NotFound desc = could not find container \"0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e\": container with ID starting with 0f957ea006e865488921b52b2d94a426c58bb0493706442b33eaacd2881ff03e not found: ID does not exist"
Sep 11 12:55:44.283298 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.283274    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:55:44.287131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.287114    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c689a2-fcbff8dff-dzc49"]
Sep 11 12:55:44.328878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:44.328843    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:45.877169 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:45.877136    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" path="/var/lib/kubelet/pods/9ed2e92d-5a95-4b29-b6ba-51099d5520c1/volumes"
Sep 11 12:55:49.432699 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:49.432664    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:55:53.678603 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:55:53.678569    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:56:11.913815 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:11.913781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:12.478896 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:12.478858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:25.520824 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:25.520740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:27.035804 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:27.035769    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:42.327497 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:42.327412    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.643296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:49.643259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.698825 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:49.698799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:49.878921 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:49.878897    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:56:49.879154 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:49.879106    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy" containerID="cri-o://d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090" gracePeriod=30
Sep 11 12:56:49.892676 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:49.892647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:50.345494 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:50.345447    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:56:55.126224 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.126197    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:56:55.217769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217712    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.217769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217744    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.217769 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217760    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.217963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217777    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.217963 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217925    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.218105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217979    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.218105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.217999    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data" (OuterVolumeSpecName: "istio-data") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:56:55.218105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218020    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsplc\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.218105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218022    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:56:55.218105 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218072    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.218363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218122    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo\") pod \"011ddc3c-705a-4b77-88fd-90c31ae83c77\" (UID: \"011ddc3c-705a-4b77-88fd-90c31ae83c77\") "
Sep 11 12:56:55.218363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218252    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:56:55.218363 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218277    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:56:55.218527 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218374    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:56:55.218615 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218594    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.218689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218619    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.218689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218633    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/011ddc3c-705a-4b77-88fd-90c31ae83c77-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.218689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218646    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.218689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.218659    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.219932 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.219906    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token" (OuterVolumeSpecName: "istio-token") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:56:55.220145 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.220120    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:56:55.220224 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.220144    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc" (OuterVolumeSpecName: "kube-api-access-dsplc") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "kube-api-access-dsplc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:56:55.220224 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.220174    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "011ddc3c-705a-4b77-88fd-90c31ae83c77" (UID: "011ddc3c-705a-4b77-88fd-90c31ae83c77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:56:55.319635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.319614    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.319635 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.319633    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.319775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.319642    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsplc\" (UniqueName: \"kubernetes.io/projected/011ddc3c-705a-4b77-88fd-90c31ae83c77-kube-api-access-dsplc\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.319775 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.319652    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/011ddc3c-705a-4b77-88fd-90c31ae83c77-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:56:55.676949 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.676913    2584 generic.go:356] "Generic (PLEG): container finished" podID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerID="d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090" exitCode=0
Sep 11 12:56:55.677142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.676971    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"
Sep 11 12:56:55.677142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.677004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerDied","Data":"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"}
Sep 11 12:56:55.677142 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.677117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48" event={"ID":"011ddc3c-705a-4b77-88fd-90c31ae83c77","Type":"ContainerDied","Data":"9094a222a3c20a8069f5c89ff0ddc58b94d34fcbe93dfb10b460867cb5a8dfc9"}
Sep 11 12:56:55.677291 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.677146    2584 scope.go:117] "RemoveContainer" containerID="d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"
Sep 11 12:56:55.688199 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.688179    2584 scope.go:117] "RemoveContainer" containerID="acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"
Sep 11 12:56:55.696792 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.696775    2584 scope.go:117] "RemoveContainer" containerID="d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"
Sep 11 12:56:55.697042 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:56:55.697009    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090\": container with ID starting with d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090 not found: ID does not exist" containerID="d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"
Sep 11 12:56:55.697130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.697043    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090"} err="failed to get container status \"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090\": rpc error: code = NotFound desc = could not find container \"d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090\": container with ID starting with d5495b954e249521ccb3752281eede85e27a3d5c9d35a92c4c2110e8281e7090 not found: ID does not exist"
Sep 11 12:56:55.697130 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.697065    2584 scope.go:117] "RemoveContainer" containerID="acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"
Sep 11 12:56:55.697396 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:56:55.697370    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c\": container with ID starting with acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c not found: ID does not exist" containerID="acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"
Sep 11 12:56:55.697515 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.697404    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c"} err="failed to get container status \"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c\": rpc error: code = NotFound desc = could not find container \"acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c\": container with ID starting with acca928aa88e76c715b205f4806fcaa957e653a7faa606a3bc4b442597a8144c not found: ID does not exist"
Sep 11 12:56:55.701509 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.701482    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:56:55.704827 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.704804    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c689a2-openshift-default-697f6467b8-wdc48"]
Sep 11 12:56:55.877644 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:56:55.877601    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" path="/var/lib/kubelet/pods/011ddc3c-705a-4b77-88fd-90c31ae83c77/volumes"
Sep 11 12:57:00.803868 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:00.803838    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:57:00.804414 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:00.804083    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" podUID="3650b043-04c7-4916-821a-3317fa7366eb" containerName="maas-api" containerID="cri-o://d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71" gracePeriod=30
Sep 11 12:57:00.828988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:00.828955    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.899091 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:00.899057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:00.964381 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:00.964328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.053830 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.053805    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:57:01.063694 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.063618    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.169331 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls\") pod \"3650b043-04c7-4916-821a-3317fa7366eb\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") "
Sep 11 12:57:01.169514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca\") pod \"3650b043-04c7-4916-821a-3317fa7366eb\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") "
Sep 11 12:57:01.169514 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169430    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h8js\" (UniqueName: \"kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js\") pod \"3650b043-04c7-4916-821a-3317fa7366eb\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") "
Sep 11 12:57:01.169645 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169564    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs\") pod \"3650b043-04c7-4916-821a-3317fa7366eb\" (UID: \"3650b043-04c7-4916-821a-3317fa7366eb\") "
Sep 11 12:57:01.169779 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169754    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3650b043-04c7-4916-821a-3317fa7366eb" (UID: "3650b043-04c7-4916-821a-3317fa7366eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:01.170008 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.169990    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3650b043-04c7-4916-821a-3317fa7366eb-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:01.171560 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.171536    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3650b043-04c7-4916-821a-3317fa7366eb" (UID: "3650b043-04c7-4916-821a-3317fa7366eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:01.171657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.171613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3650b043-04c7-4916-821a-3317fa7366eb" (UID: "3650b043-04c7-4916-821a-3317fa7366eb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:01.171657 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.171643    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js" (OuterVolumeSpecName: "kube-api-access-6h8js") pod "3650b043-04c7-4916-821a-3317fa7366eb" (UID: "3650b043-04c7-4916-821a-3317fa7366eb"). InnerVolumeSpecName "kube-api-access-6h8js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:01.270925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.270892    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:01.270925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.270921    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h8js\" (UniqueName: \"kubernetes.io/projected/3650b043-04c7-4916-821a-3317fa7366eb-kube-api-access-6h8js\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:01.270925 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.270931    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3650b043-04c7-4916-821a-3317fa7366eb-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:01.394062 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.393939    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:01.711808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.711726    2584 generic.go:356] "Generic (PLEG): container finished" podID="3650b043-04c7-4916-821a-3317fa7366eb" containerID="d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71" exitCode=0
Sep 11 12:57:01.711808 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.711773    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"
Sep 11 12:57:01.711985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.711815    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" event={"ID":"3650b043-04c7-4916-821a-3317fa7366eb","Type":"ContainerDied","Data":"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"}
Sep 11 12:57:01.711985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.711869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h" event={"ID":"3650b043-04c7-4916-821a-3317fa7366eb","Type":"ContainerDied","Data":"4ba436b677a4c19fe18194c392b4e5eef1128f45eb516a41993fbeb252b83475"}
Sep 11 12:57:01.711985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.711893    2584 scope.go:117] "RemoveContainer" containerID="d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"
Sep 11 12:57:01.721471 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.721455    2584 scope.go:117] "RemoveContainer" containerID="d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"
Sep 11 12:57:01.721721 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:01.721700    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71\": container with ID starting with d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71 not found: ID does not exist" containerID="d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"
Sep 11 12:57:01.721764 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.721729    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71"} err="failed to get container status \"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71\": rpc error: code = NotFound desc = could not find container \"d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71\": container with ID starting with d69a98b3209519cc71ed3cdfa9ab55a88e4b24e643bf7990b94f7dc1e5fd6c71 not found: ID does not exist"
Sep 11 12:57:01.733575 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.733552    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:57:01.738005 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.737971    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-c5dca3-545fd7f5b6-q746h"]
Sep 11 12:57:01.877249 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:01.877226    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3650b043-04c7-4916-821a-3317fa7366eb" path="/var/lib/kubelet/pods/3650b043-04c7-4916-821a-3317fa7366eb/volumes"
Sep 11 12:57:03.781139 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:03.781106    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:57:07.202692 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.202655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.262367 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.262325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.443137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.443104    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:57:07.443344 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.443322    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy" containerID="cri-o://dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184" gracePeriod=30
Sep 11 12:57:07.455793 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.455731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.777745 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.777716    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"]
Sep 11 12:57:07.778119 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778105    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778121    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778131    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778137    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778159    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778166    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778174    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" containerName="maas-api"
Sep 11 12:57:07.778178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778179    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" containerName="maas-api"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778186    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3650b043-04c7-4916-821a-3317fa7366eb" containerName="maas-api"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778191    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3650b043-04c7-4916-821a-3317fa7366eb" containerName="maas-api"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778204    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778209    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778265    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778273    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ed2e92d-5a95-4b29-b6ba-51099d5520c1" containerName="maas-api"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778281    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3650b043-04c7-4916-821a-3317fa7366eb" containerName="maas-api"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778288    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.778385 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.778294    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="011ddc3c-705a-4b77-88fd-90c31ae83c77" containerName="istio-proxy"
Sep 11 12:57:07.782503 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.782486    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:07.784988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.784961    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:57:07.784988 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.784981    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:57:07.791396 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.791373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"]
Sep 11 12:57:07.921556 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.921525    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:07.928573 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:07.928541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4\" (UID: \"5455a417-62a8-4336-b575-2f257a86f1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:08.029627 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.029546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4\" (UID: \"5455a417-62a8-4336-b575-2f257a86f1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:08.030159 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.030142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4\" (UID: \"5455a417-62a8-4336-b575-2f257a86f1be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:08.093798 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.093766    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:08.365647 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.365622    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"]
Sep 11 12:57:08.367898 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:57:08.367866    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5455a417_62a8_4336_b575_2f257a86f1be.slice/crio-2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843 WatchSource:0}: Error finding container 2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843: Status 404 returned error can't find the container with id 2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843
Sep 11 12:57:08.757611 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.757581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4" event={"ID":"5455a417-62a8-4336-b575-2f257a86f1be","Type":"ContainerStarted","Data":"0c5580bf8ae0ce99f7dc20e01247cb013bc3748bbfae4df95e4766201ba143d5"}
Sep 11 12:57:08.757736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.757628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4" event={"ID":"5455a417-62a8-4336-b575-2f257a86f1be","Type":"ContainerStarted","Data":"2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843"}
Sep 11 12:57:08.776143 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:08.776100    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4" podStartSLOduration=1.776078467 podStartE2EDuration="1.776078467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:08.77359306 +0000 UTC m=+1821.417485716" watchObservedRunningTime="2026-09-11 12:57:08.776078467 +0000 UTC m=+1821.419971124"
Sep 11 12:57:09.764094 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:09.764052    2584 generic.go:356] "Generic (PLEG): container finished" podID="5455a417-62a8-4336-b575-2f257a86f1be" containerID="0c5580bf8ae0ce99f7dc20e01247cb013bc3748bbfae4df95e4766201ba143d5" exitCode=0
Sep 11 12:57:09.764477 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:09.764132    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4" event={"ID":"5455a417-62a8-4336-b575-2f257a86f1be","Type":"ContainerDied","Data":"0c5580bf8ae0ce99f7dc20e01247cb013bc3748bbfae4df95e4766201ba143d5"}
Sep 11 12:57:10.896196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:10.896175    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:11.052768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.052687    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca\") pod \"5455a417-62a8-4336-b575-2f257a86f1be\" (UID: \"5455a417-62a8-4336-b575-2f257a86f1be\") "
Sep 11 12:57:11.053003 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.052981    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5455a417-62a8-4336-b575-2f257a86f1be" (UID: "5455a417-62a8-4336-b575-2f257a86f1be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:11.154230 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.154201    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455a417-62a8-4336-b575-2f257a86f1be-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:11.776366 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.776338    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"
Sep 11 12:57:11.776656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.776372    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4" event={"ID":"5455a417-62a8-4336-b575-2f257a86f1be","Type":"ContainerDied","Data":"2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843"}
Sep 11 12:57:11.776656 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:11.776419    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e719913ddf1d08f32285799668cc8414a3c447e9bcb0e4077ce94bfd86ae843"
Sep 11 12:57:12.699698 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.699675    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:57:12.765731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765707    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.765866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765738    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.765866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765759    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.765866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765780    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.765866 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765807    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tbsb\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.766069 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.765885    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.766131 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.766087    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:12.766262 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.766240    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.766341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.766238    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:12.766341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.766259    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:12.768021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.767991    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:12.768021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.768005    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb" (OuterVolumeSpecName: "kube-api-access-5tbsb") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "kube-api-access-5tbsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:12.768021 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.768061    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:57:12.785825 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.785796    2584 generic.go:356] "Generic (PLEG): container finished" podID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerID="dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184" exitCode=0
Sep 11 12:57:12.785955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.785844    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"
Sep 11 12:57:12.785955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.785877    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerDied","Data":"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"}
Sep 11 12:57:12.785955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.785951    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857" event={"ID":"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4","Type":"ContainerDied","Data":"6cb9fb2073bfc6b3447df119fe09dfdebac681faba71a1f3e57064c364a9696a"}
Sep 11 12:57:12.786149 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.785982    2584 scope.go:117] "RemoveContainer" containerID="dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"
Sep 11 12:57:12.794580 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.794563    2584 scope.go:117] "RemoveContainer" containerID="ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"
Sep 11 12:57:12.803043 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.803015    2584 scope.go:117] "RemoveContainer" containerID="dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"
Sep 11 12:57:12.803388 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:12.803370    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184\": container with ID starting with dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184 not found: ID does not exist" containerID="dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"
Sep 11 12:57:12.803467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.803395    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184"} err="failed to get container status \"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184\": rpc error: code = NotFound desc = could not find container \"dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184\": container with ID starting with dc290d5acc3b9bc83bfc7f18d067e32476c4643472cb6962dd338d65611f3184 not found: ID does not exist"
Sep 11 12:57:12.803467 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.803411    2584 scope.go:117] "RemoveContainer" containerID="ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"
Sep 11 12:57:12.803697 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:12.803678    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199\": container with ID starting with ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199 not found: ID does not exist" containerID="ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"
Sep 11 12:57:12.803736 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.803711    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199"} err="failed to get container status \"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199\": rpc error: code = NotFound desc = could not find container \"ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199\": container with ID starting with ff335f44cb99d976b2ed314931e12140043c4b4201e0c93ce14e78a813781199 not found: ID does not exist"
Sep 11 12:57:12.867380 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867352    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.867484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867398    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.867484 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867419    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs\") pod \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\" (UID: \"35d44e93-cc21-4f61-b5ad-9ad7df25f9e4\") "
Sep 11 12:57:12.867675 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867658    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tbsb\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-kube-api-access-5tbsb\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.867716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867696    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.867716 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867707    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.867788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867717    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.867788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867725    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.867788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867661    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:12.867788 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.867688    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:12.869175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.869154    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" (UID: "35d44e93-cc21-4f61-b5ad-9ad7df25f9e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:12.968986 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.968933    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.968986 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.968978    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:12.968986 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:12.968992    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:13.109106 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:13.109071    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:57:13.112429 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:13.112406    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c5dca3-openshift-default-6b4b5d8c94-fc857"]
Sep 11 12:57:13.189334 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:13.189302    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:13.244143 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:13.244109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:13.877164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:13.877131    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" path="/var/lib/kubelet/pods/35d44e93-cc21-4f61-b5ad-9ad7df25f9e4/volumes"
Sep 11 12:57:18.447164 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.447128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:18.545669 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.545634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:18.561601 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.561577    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"]
Sep 11 12:57:18.563658 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.563637    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c0bbb3-nq7j4"]
Sep 11 12:57:18.613687 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.613658    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:18.937066 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:18.937013    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:19.876897 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:19.876863    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5455a417-62a8-4336-b575-2f257a86f1be" path="/var/lib/kubelet/pods/5455a417-62a8-4336-b575-2f257a86f1be/volumes"
Sep 11 12:57:21.191633 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:21.191600    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:57:24.911970 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:24.911920    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:24.975246 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:24.975206    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:25.169731 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.169638    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:57:25.169927 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.169885    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" containerID="cri-o://f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07" gracePeriod=30
Sep 11 12:57:25.192540 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.192514    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:25.531789 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.531752    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"]
Sep 11 12:57:25.532158 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532143    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5455a417-62a8-4336-b575-2f257a86f1be" containerName="revoke-keys"
Sep 11 12:57:25.532211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532159    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5455a417-62a8-4336-b575-2f257a86f1be" containerName="revoke-keys"
Sep 11 12:57:25.532211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532172    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 12:57:25.532211 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532184    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 12:57:25.532323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532254    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5455a417-62a8-4336-b575-2f257a86f1be" containerName="revoke-keys"
Sep 11 12:57:25.532323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532265    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2246d40a-0578-4637-a909-cff418acb29d" containerName="istio-proxy"
Sep 11 12:57:25.532323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532274    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 12:57:25.532323 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.532280    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 12:57:25.535265 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.535249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:25.537862 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.537832    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:57:25.537985 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.537906    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 12:57:25.543243 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.543219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"]
Sep 11 12:57:25.574322 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.574287    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl\" (UID: \"b05acc35-61da-4b47-a381-e713070cbfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:25.675600 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.675563    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl\" (UID: \"b05acc35-61da-4b47-a381-e713070cbfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:25.676199 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.676179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl\" (UID: \"b05acc35-61da-4b47-a381-e713070cbfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:25.720748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.720713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:25.847968 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:25.847887    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:26.150135 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.150106    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"]
Sep 11 12:57:26.151974 ip-10-0-143-248 kubenswrapper[2584]: W0911 12:57:26.151949    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05acc35_61da_4b47_a381_e713070cbfed.slice/crio-a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7 WatchSource:0}: Error finding container a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7: Status 404 returned error can't find the container with id a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7
Sep 11 12:57:26.597017 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.596979    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:57:26.597196 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.597062    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:57:26.871688 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.871617    2584 generic.go:356] "Generic (PLEG): container finished" podID="b05acc35-61da-4b47-a381-e713070cbfed" containerID="fac5e9b9ca6d7fd5b22d4553907dcf79ca52935507da330e9b45aa7be1b7ad8b" exitCode=0
Sep 11 12:57:26.871810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.871678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl" event={"ID":"b05acc35-61da-4b47-a381-e713070cbfed","Type":"ContainerDied","Data":"fac5e9b9ca6d7fd5b22d4553907dcf79ca52935507da330e9b45aa7be1b7ad8b"}
Sep 11 12:57:26.871810 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:26.871723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl" event={"ID":"b05acc35-61da-4b47-a381-e713070cbfed","Type":"ContainerStarted","Data":"a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7"}
Sep 11 12:57:28.006962 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.006937    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:28.096296 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.096265    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca\") pod \"b05acc35-61da-4b47-a381-e713070cbfed\" (UID: \"b05acc35-61da-4b47-a381-e713070cbfed\") "
Sep 11 12:57:28.096641 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.096617    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b05acc35-61da-4b47-a381-e713070cbfed" (UID: "b05acc35-61da-4b47-a381-e713070cbfed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:28.197668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.197590    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05acc35-61da-4b47-a381-e713070cbfed-maas-api-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:28.884887 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.884843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl" event={"ID":"b05acc35-61da-4b47-a381-e713070cbfed","Type":"ContainerDied","Data":"a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7"}
Sep 11 12:57:28.885074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.884899    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a63be8bda529cbbe096fc40fb793ca90bc160bbae945368a65633bd3c265fde7"
Sep 11 12:57:28.885074 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:28.884868    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"
Sep 11 12:57:30.427173 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.427149    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:57:30.518748 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.518714    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.518934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.518767    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.518934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.518796    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.518934 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.518842    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.518986    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519082    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519115    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:30.519141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519122    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:30.519349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519183    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519216    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkfwt\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt\") pod \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\" (UID: \"5d7c0e1d-9620-463d-98db-7d688c4eecf4\") "
Sep 11 12:57:30.519349 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519337    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:30.519580 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519350    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:30.519580 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519560    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:30.519689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519576    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.519689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519597    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.519689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519611    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.519689 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.519625    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.521271 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.521242    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:30.521271 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.521243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:57:30.521428 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.521287    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:30.521474 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.521452    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt" (OuterVolumeSpecName: "kube-api-access-gkfwt") pod "5d7c0e1d-9620-463d-98db-7d688c4eecf4" (UID: "5d7c0e1d-9620-463d-98db-7d688c4eecf4"). InnerVolumeSpecName "kube-api-access-gkfwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:30.555768 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.555736    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:30.620604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.620570    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.620604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.620598    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.620604 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.620607    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkfwt\" (UniqueName: \"kubernetes.io/projected/5d7c0e1d-9620-463d-98db-7d688c4eecf4-kube-api-access-gkfwt\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.620834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.620618    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.620834 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.620626    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d7c0e1d-9620-463d-98db-7d688c4eecf4-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:30.897878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.897790    2584 generic.go:356] "Generic (PLEG): container finished" podID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerID="f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07" exitCode=0
Sep 11 12:57:30.897878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.897842    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"
Sep 11 12:57:30.897878 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.897860    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerDied","Data":"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"}
Sep 11 12:57:30.898137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.897916    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n" event={"ID":"5d7c0e1d-9620-463d-98db-7d688c4eecf4","Type":"ContainerDied","Data":"545d64b0877a2d287a827fbad13c806f7c1e8d4c5e498e724082388a0fa30e1a"}
Sep 11 12:57:30.898137 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.897948    2584 scope.go:117] "RemoveContainer" containerID="f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"
Sep 11 12:57:30.910485 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.910437    2584 scope.go:117] "RemoveContainer" containerID="94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"
Sep 11 12:57:30.919532 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.919507    2584 scope.go:117] "RemoveContainer" containerID="f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"
Sep 11 12:57:30.919830 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:30.919805    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07\": container with ID starting with f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07 not found: ID does not exist" containerID="f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"
Sep 11 12:57:30.919875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.919843    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07"} err="failed to get container status \"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07\": rpc error: code = NotFound desc = could not find container \"f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07\": container with ID starting with f5f4fac9512f950ad6e23b55416824dbf1c5cc8aeff32a030ac5585991ff4d07 not found: ID does not exist"
Sep 11 12:57:30.919875 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.919867    2584 scope.go:117] "RemoveContainer" containerID="94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"
Sep 11 12:57:30.920207 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:30.920187    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d\": container with ID starting with 94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d not found: ID does not exist" containerID="94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"
Sep 11 12:57:30.920261 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.920213    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d"} err="failed to get container status \"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d\": rpc error: code = NotFound desc = could not find container \"94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d\": container with ID starting with 94a8e074b996e02ee42827e0746131c04f094a0a0ffa9100d0efbb9705b7525d not found: ID does not exist"
Sep 11 12:57:30.921914 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.921887    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:57:30.926953 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:30.926931    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c0bbb3-openshift-default-765b6d8c4d-pp72n"]
Sep 11 12:57:31.877638 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:31.877602    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" path="/var/lib/kubelet/pods/5d7c0e1d-9620-463d-98db-7d688c4eecf4/volumes"
Sep 11 12:57:35.777710 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:35.777664    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:36.730051 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:36.730001    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"]
Sep 11 12:57:36.733668 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:36.733639    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-1337fa-ct8dl"]
Sep 11 12:57:37.406236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:37.406199    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:37.876989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:37.876959    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05acc35-61da-4b47-a381-e713070cbfed" path="/var/lib/kubelet/pods/b05acc35-61da-4b47-a381-e713070cbfed/volumes"
Sep 11 12:57:38.987650 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:38.987613    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:57:43.369738 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:43.369693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:43.469999 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:43.469963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:43.690833 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:43.690753    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:57:43.691036 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:43.691001    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy" containerID="cri-o://6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d" gracePeriod=30
Sep 11 12:57:43.753853 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:43.753825    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:57:47.688740 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:47.688705    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:57:48.965168 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.965098    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:57:48.998178 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.998141    2584 generic.go:356] "Generic (PLEG): container finished" podID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerID="6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d" exitCode=0
Sep 11 12:57:48.998341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.998191    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"
Sep 11 12:57:48.998341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.998219    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerDied","Data":"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"}
Sep 11 12:57:48.998341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.998270    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w" event={"ID":"e8ff7b12-1df3-478a-b07d-a995a2991079","Type":"ContainerDied","Data":"8f3280a3a016b42b96388e58d69a7330a72823ca737a849c5bd8cd302a0723ab"}
Sep 11 12:57:48.998341 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:48.998297    2584 scope.go:117] "RemoveContainer" containerID="6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"
Sep 11 12:57:49.006989 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.006965    2584 scope.go:117] "RemoveContainer" containerID="096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"
Sep 11 12:57:49.014975 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.014954    2584 scope.go:117] "RemoveContainer" containerID="6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"
Sep 11 12:57:49.015289 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:49.015271    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d\": container with ID starting with 6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d not found: ID does not exist" containerID="6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"
Sep 11 12:57:49.015356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.015297    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d"} err="failed to get container status \"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d\": rpc error: code = NotFound desc = could not find container \"6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d\": container with ID starting with 6e2ea4e081512f226d9f767a2209a9c56148f73faf62137ff3e524d68ac9784d not found: ID does not exist"
Sep 11 12:57:49.015356 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.015312    2584 scope.go:117] "RemoveContainer" containerID="096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"
Sep 11 12:57:49.015588 ip-10-0-143-248 kubenswrapper[2584]: E0911 12:57:49.015567    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2\": container with ID starting with 096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2 not found: ID does not exist" containerID="096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"
Sep 11 12:57:49.015628 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.015600    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2"} err="failed to get container status \"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2\": rpc error: code = NotFound desc = could not find container \"096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2\": container with ID starting with 096f454ff72ed9ac8d2169cbd2a3021540c300c56be446f8411f822df7ecbdd2 not found: ID does not exist"
Sep 11 12:57:49.074907 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.074879    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.074931    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.074954    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.074981    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075002    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075043    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075065    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075104 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075089    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075455 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075146    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhs5g\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g\") pod \"e8ff7b12-1df3-478a-b07d-a995a2991079\" (UID: \"e8ff7b12-1df3-478a-b07d-a995a2991079\") "
Sep 11 12:57:49.075455 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075236    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:49.075570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075454    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:49.075570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075463    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.075570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075481    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:49.075570 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:49.075734 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.075620    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:49.077286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.077258    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g" (OuterVolumeSpecName: "kube-api-access-bhs5g") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "kube-api-access-bhs5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:49.077286 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.077261    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:57:49.077523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.077495    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:49.077523 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.077507    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8ff7b12-1df3-478a-b07d-a995a2991079" (UID: "e8ff7b12-1df3-478a-b07d-a995a2991079"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:49.176464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176435    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-token\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176460    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ff7b12-1df3-478a-b07d-a995a2991079-istiod-ca-cert\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176464 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176468    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-podinfo\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176476    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-envoy\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176485    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-credential-socket\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176495    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-istio-data\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176502    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ff7b12-1df3-478a-b07d-a995a2991079-workload-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.176679 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.176510    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhs5g\" (UniqueName: \"kubernetes.io/projected/e8ff7b12-1df3-478a-b07d-a995a2991079-kube-api-access-bhs5g\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 12:57:49.322436 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.322403    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:57:49.327064 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.327020    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-1337fa-openshift-default-7f4df65856-5s24w"]
Sep 11 12:57:49.877236 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:57:49.877202    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" path="/var/lib/kubelet/pods/e8ff7b12-1df3-478a-b07d-a995a2991079/volumes"
Sep 11 12:58:26.177023 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:58:26.176975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:27.864955 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:58:27.864909    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:58:27.965184 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:58:27.965151    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:08.877304 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:08.877272    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:09.650613 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:09.650576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:09.804486 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:09.804450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:59:11.145281 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:11.145243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 12:59:35.182175 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:35.182142    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:59:42.593112 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:42.593021    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:59:49.437617 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:49.437579    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 12:59:57.007141 ip-10-0-143-248 kubenswrapper[2584]: I0911 12:59:57.007109    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:00:00.135198 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135163    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"]
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135539    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135551    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135559    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135568    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135582    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135588    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135594    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05acc35-61da-4b47-a381-e713070cbfed" containerName="revoke-keys"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135599    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05acc35-61da-4b47-a381-e713070cbfed" containerName="revoke-keys"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135611    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135615    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d44e93-cc21-4f61-b5ad-9ad7df25f9e4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135686    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135694    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05acc35-61da-4b47-a381-e713070cbfed" containerName="revoke-keys"
Sep 11 13:00:00.137391 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.135703    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:00:00.138472 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.138457    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"
Sep 11 13:00:00.141151 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.141130    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ww7tv\""
Sep 11 13:00:00.146389 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.146370    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"]
Sep 11 13:00:00.149183 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.149165    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"
Sep 11 13:00:00.418718 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.418694    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"]
Sep 11 13:00:00.420935 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:00:00.420907    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46cc126b_f3e4_4d2d_ab7b_0dac99a50e0f.slice/crio-b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c WatchSource:0}: Error finding container b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c: Status 404 returned error can't find the container with id b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c
Sep 11 13:00:00.719321 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:00.719243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg" event={"ID":"46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f","Type":"ContainerStarted","Data":"b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c"}
Sep 11 13:00:01.726513 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:01.726477    2584 generic.go:356] "Generic (PLEG): container finished" podID="46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f" containerID="42b0804590b69e64793422498838d41cf97a1d45b61a6baaa36787073488dee9" exitCode=0
Sep 11 13:00:01.726915 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:01.726530    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg" event={"ID":"46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f","Type":"ContainerDied","Data":"42b0804590b69e64793422498838d41cf97a1d45b61a6baaa36787073488dee9"}
Sep 11 13:00:02.218270 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:02.218228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:02.422073 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:02.422004    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:00:02.866745 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:02.866719    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"
Sep 11 13:00:03.738531 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:03.738490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg" event={"ID":"46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f","Type":"ContainerDied","Data":"b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c"}
Sep 11 13:00:03.738694 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:03.738547    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5aa6ec570610cdb66bb20e9fdb753af3fbf0197020031a5f1e3c897920ac43c"
Sep 11 13:00:03.738694 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:03.738508    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818860-mkmlg"
Sep 11 13:00:09.678786 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:09.678749    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:00:17.822735 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:17.822692    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:00:24.821534 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:24.821502    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 13:00:24.821968 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:24.821711    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" podUID="46599b0c-67a7-4b95-a397-86a060094958" containerName="manager" containerID="cri-o://54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309" gracePeriod=10
Sep 11 13:00:25.071143 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.071118    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 13:00:25.200322 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.200247    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79wb6\" (UniqueName: \"kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6\") pod \"46599b0c-67a7-4b95-a397-86a060094958\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") "
Sep 11 13:00:25.200322 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.200313    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume\") pod \"46599b0c-67a7-4b95-a397-86a060094958\" (UID: \"46599b0c-67a7-4b95-a397-86a060094958\") "
Sep 11 13:00:25.200627 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.200602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46599b0c-67a7-4b95-a397-86a060094958" (UID: "46599b0c-67a7-4b95-a397-86a060094958"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:00:25.202366 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.202332    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6" (OuterVolumeSpecName: "kube-api-access-79wb6") pod "46599b0c-67a7-4b95-a397-86a060094958" (UID: "46599b0c-67a7-4b95-a397-86a060094958"). InnerVolumeSpecName "kube-api-access-79wb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:00:25.301769 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.301735    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46599b0c-67a7-4b95-a397-86a060094958-extensions-socket-volume\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:00:25.301769 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.301764    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79wb6\" (UniqueName: \"kubernetes.io/projected/46599b0c-67a7-4b95-a397-86a060094958-kube-api-access-79wb6\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:00:25.867077 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.867046    2584 generic.go:356] "Generic (PLEG): container finished" podID="46599b0c-67a7-4b95-a397-86a060094958" containerID="54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309" exitCode=0
Sep 11 13:00:25.867541 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.867086    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"
Sep 11 13:00:25.867541 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.867119    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" event={"ID":"46599b0c-67a7-4b95-a397-86a060094958","Type":"ContainerDied","Data":"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"}
Sep 11 13:00:25.867541 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.867186    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f" event={"ID":"46599b0c-67a7-4b95-a397-86a060094958","Type":"ContainerDied","Data":"d6a01608947dc63ddc6581a05b5973cf514330e881d7a766d3f33158cf21a294"}
Sep 11 13:00:25.867541 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.867219    2584 scope.go:117] "RemoveContainer" containerID="54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"
Sep 11 13:00:25.878110 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.878088    2584 scope.go:117] "RemoveContainer" containerID="54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"
Sep 11 13:00:25.878382 ip-10-0-143-248 kubenswrapper[2584]: E0911 13:00:25.878363    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309\": container with ID starting with 54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309 not found: ID does not exist" containerID="54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"
Sep 11 13:00:25.878479 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.878391    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309"} err="failed to get container status \"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309\": rpc error: code = NotFound desc = could not find container \"54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309\": container with ID starting with 54c9827e679e72abdfb5fd3bc1876a870102aa27a3b7eb29dab122d2a472b309 not found: ID does not exist"
Sep 11 13:00:25.889888 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.889864    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 13:00:25.898191 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:25.896880    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zvr6f"]
Sep 11 13:00:27.877381 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:00:27.877344    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46599b0c-67a7-4b95-a397-86a060094958" path="/var/lib/kubelet/pods/46599b0c-67a7-4b95-a397-86a060094958/volumes"
Sep 11 13:01:25.565294 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565216    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"]
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565589    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46599b0c-67a7-4b95-a397-86a060094958" containerName="manager"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46599b0c-67a7-4b95-a397-86a060094958" containerName="manager"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565613    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565618    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565628    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f" containerName="cleanup"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565633    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f" containerName="cleanup"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565683    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f" containerName="cleanup"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565691    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ff7b12-1df3-478a-b07d-a995a2991079" containerName="istio-proxy"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565698    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7c0e1d-9620-463d-98db-7d688c4eecf4" containerName="istio-proxy"
Sep 11 13:01:25.565739 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.565705    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46599b0c-67a7-4b95-a397-86a060094958" containerName="manager"
Sep 11 13:01:25.568693 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.568677    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.572020 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.572000    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7j69\""
Sep 11 13:01:25.584911 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.584883    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"]
Sep 11 13:01:25.677614 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.677586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96qc\" (UniqueName: \"kubernetes.io/projected/312d8ad1-0b76-4b57-bdc6-0c834d915770-kube-api-access-r96qc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.677736 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.677619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/312d8ad1-0b76-4b57-bdc6-0c834d915770-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.779625 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.779481    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96qc\" (UniqueName: \"kubernetes.io/projected/312d8ad1-0b76-4b57-bdc6-0c834d915770-kube-api-access-r96qc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.779772 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.779641    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/312d8ad1-0b76-4b57-bdc6-0c834d915770-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.780089 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.780068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/312d8ad1-0b76-4b57-bdc6-0c834d915770-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.791291 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.791263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96qc\" (UniqueName: \"kubernetes.io/projected/312d8ad1-0b76-4b57-bdc6-0c834d915770-kube-api-access-r96qc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lkcwf\" (UID: \"312d8ad1-0b76-4b57-bdc6-0c834d915770\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:25.878168 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:25.878111    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:26.165799 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:26.165776    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"]
Sep 11 13:01:26.168023 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:01:26.167994    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312d8ad1_0b76_4b57_bdc6_0c834d915770.slice/crio-34e14624becfbb82a6da5602a9b77723adb6335360283d7b1585c4d19e6af910 WatchSource:0}: Error finding container 34e14624becfbb82a6da5602a9b77723adb6335360283d7b1585c4d19e6af910: Status 404 returned error can't find the container with id 34e14624becfbb82a6da5602a9b77723adb6335360283d7b1585c4d19e6af910
Sep 11 13:01:26.183427 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:26.183397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf" event={"ID":"312d8ad1-0b76-4b57-bdc6-0c834d915770","Type":"ContainerStarted","Data":"34e14624becfbb82a6da5602a9b77723adb6335360283d7b1585c4d19e6af910"}
Sep 11 13:01:27.190765 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:27.190729    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf" event={"ID":"312d8ad1-0b76-4b57-bdc6-0c834d915770","Type":"ContainerStarted","Data":"c3f7656eae2e83cef0e25ab799dd846567c297f8b9b8441ccd9dd512ec430985"}
Sep 11 13:01:27.191233 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:27.190834    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:27.235662 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:27.235609    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf" podStartSLOduration=2.235593272 podStartE2EDuration="2.235593272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:27.232440416 +0000 UTC m=+2079.876333072" watchObservedRunningTime="2026-09-11 13:01:27.235593272 +0000 UTC m=+2079.879485977"
Sep 11 13:01:38.198763 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:38.198730    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lkcwf"
Sep 11 13:01:46.689642 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:46.689606    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:01:52.305144 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:01:52.305111    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:03.795747 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.795715    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:03.799568 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.799546    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.802658 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.802631    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:02:03.803848 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.803827    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-de400b32-kserve-self-signed-certs\""
Sep 11 13:02:03.803960 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.803940    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:02:03.804067 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.803950    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-67t6s\""
Sep 11 13:02:03.810943 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.810920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:03.870469 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.870430    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:03.886512 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886491    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.886618 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886532    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.886618 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.886618 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.886748 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.886748 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.886646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr9pr\" (UniqueName: \"kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987347 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987484 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987484 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987484 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr9pr\" (UniqueName: \"kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987643 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987696 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987826 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.987955 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.988018 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.987953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.989690 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.989674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.989791 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.989776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:03.998680 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:03.998655    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr9pr\" (UniqueName: \"kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr\") pod \"e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") " pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:04.109348 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:04.109295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:04.386720 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:04.386677    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:04.389417 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:02:04.389385    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod112670d1_bddf_4348_ae3e_35a3d8cc8ae4.slice/crio-893d552734db899b82ffcc03194dcb24ef772a3e87af8fcbdd6a03508eb27a45 WatchSource:0}: Error finding container 893d552734db899b82ffcc03194dcb24ef772a3e87af8fcbdd6a03508eb27a45: Status 404 returned error can't find the container with id 893d552734db899b82ffcc03194dcb24ef772a3e87af8fcbdd6a03508eb27a45
Sep 11 13:02:04.403742 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:04.403707    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" event={"ID":"112670d1-bddf-4348-ae3e-35a3d8cc8ae4","Type":"ContainerStarted","Data":"893d552734db899b82ffcc03194dcb24ef772a3e87af8fcbdd6a03508eb27a45"}
Sep 11 13:02:05.411440 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:05.411403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" event={"ID":"112670d1-bddf-4348-ae3e-35a3d8cc8ae4","Type":"ContainerStarted","Data":"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"}
Sep 11 13:02:05.432549 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:05.432500    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" podStartSLOduration=2.432486122 podStartE2EDuration="2.432486122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:05.430467171 +0000 UTC m=+2118.074359828" watchObservedRunningTime="2026-09-11 13:02:05.432486122 +0000 UTC m=+2118.076378778"
Sep 11 13:02:06.086932 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:06.086896    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:13.625448 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:13.625409    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:14.110134 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:14.110094    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:14.110335 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:14.110145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:14.122155 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:14.122126    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:14.475124 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:14.475015    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:16.705913 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:16.705868    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:40.774012 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:40.773915    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:40.799455 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:40.799427    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:42.572566 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:42.572533    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:02:43.886327 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:43.886292    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:50.188858 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:50.188824    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:55.792255 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:55.792194    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" podUID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" containerName="main" containerID="cri-o://b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7" gracePeriod=45
Sep 11 13:02:56.042432 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.042369    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:56.137865 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.137839    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr9pr\" (UniqueName: \"kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138013 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.137885    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138013 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.137919    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138013 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.137977    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138013 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138003    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138261 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138024    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir\") pod \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\" (UID: \"112670d1-bddf-4348-ae3e-35a3d8cc8ae4\") "
Sep 11 13:02:56.138261 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138169    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home" (OuterVolumeSpecName: "home") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.138365 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138268    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache" (OuterVolumeSpecName: "model-cache") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.138423 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138375    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.138423 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138395    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-model-cache\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.138423 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.138414    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-home\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.140064 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.140019    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm" (OuterVolumeSpecName: "dshm") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:02:56.140064 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.140046    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr" (OuterVolumeSpecName: "kube-api-access-vr9pr") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "kube-api-access-vr9pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:02:56.140339 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.140320    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "112670d1-bddf-4348-ae3e-35a3d8cc8ae4" (UID: "112670d1-bddf-4348-ae3e-35a3d8cc8ae4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:02:56.239527 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.239503    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-dshm\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.239527 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.239525    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tls-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.239668 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.239548    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-tmp-dir\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.239668 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.239557    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr9pr\" (UniqueName: \"kubernetes.io/projected/112670d1-bddf-4348-ae3e-35a3d8cc8ae4-kube-api-access-vr9pr\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:02:56.699578 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.699531    2584 generic.go:356] "Generic (PLEG): container finished" podID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" containerID="b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7" exitCode=0
Sep 11 13:02:56.699578 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.699571    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"
Sep 11 13:02:56.699816 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.699619    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" event={"ID":"112670d1-bddf-4348-ae3e-35a3d8cc8ae4","Type":"ContainerDied","Data":"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"}
Sep 11 13:02:56.699816 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.699658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l" event={"ID":"112670d1-bddf-4348-ae3e-35a3d8cc8ae4","Type":"ContainerDied","Data":"893d552734db899b82ffcc03194dcb24ef772a3e87af8fcbdd6a03508eb27a45"}
Sep 11 13:02:56.699816 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.699675    2584 scope.go:117] "RemoveContainer" containerID="b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"
Sep 11 13:02:56.708854 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.708839    2584 scope.go:117] "RemoveContainer" containerID="b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"
Sep 11 13:02:56.709139 ip-10-0-143-248 kubenswrapper[2584]: E0911 13:02:56.709120    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7\": container with ID starting with b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7 not found: ID does not exist" containerID="b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"
Sep 11 13:02:56.709197 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.709148    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7"} err="failed to get container status \"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7\": rpc error: code = NotFound desc = could not find container \"b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7\": container with ID starting with b2adb65b61b42e8f60e35f2c44c6f6c7db5056a1834516800fbec66b34955bb7 not found: ID does not exist"
Sep 11 13:02:56.723752 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.723732    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:56.731962 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:56.731939    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-de400b32-kserve-746f87ccbc-zps7l"]
Sep 11 13:02:57.137077 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.137024    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:02:57.496011 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.495976    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:02:57.496386 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.496373    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" containerName="main"
Sep 11 13:02:57.496429 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.496390    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" containerName="main"
Sep 11 13:02:57.496464 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.496448    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" containerName="main"
Sep 11 13:02:57.500839 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.500820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.505458 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.505420    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v6tqs\""
Sep 11 13:02:57.505592 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.505476    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:02:57.505592 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.505496    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 13:02:57.505592 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.505538    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:02:57.505800 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.505785    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:02:57.520153 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.520131    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:02:57.522681 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.522661    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"]
Sep 11 13:02:57.526405 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.526364    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.539578 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.539555    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"]
Sep 11 13:02:57.550192 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.550171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.550317 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.550209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.550317 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.550228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.550438 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.550365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggz58\" (UniqueName: \"kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.651007 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.650971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggz58\" (UniqueName: \"kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.651007 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651008    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6d5222-3146-4542-8139-3d4a834c13df-openshift-service-ca\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.651264 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgsv\" (UniqueName: \"kubernetes.io/projected/dd6d5222-3146-4542-8139-3d4a834c13df-kube-api-access-lmgsv\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.651264 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651097    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-metrics-certs\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.651264 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.651264 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.651474 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-maas-api-tls\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.651474 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.651695 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.651676    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.653582 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.653561    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.653703 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.653599    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.659800 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.659772    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggz58\" (UniqueName: \"kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58\") pod \"maas-api-78cdb675f8-x92pm\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.752460 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.752401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-maas-api-tls\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.752571 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.752474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6d5222-3146-4542-8139-3d4a834c13df-openshift-service-ca\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.752571 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.752502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgsv\" (UniqueName: \"kubernetes.io/projected/dd6d5222-3146-4542-8139-3d4a834c13df-kube-api-access-lmgsv\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.752571 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.752518    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-metrics-certs\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.753157 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.753136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd6d5222-3146-4542-8139-3d4a834c13df-openshift-service-ca\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.754637 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.754611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-maas-api-tls\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.754863 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.754841    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6d5222-3146-4542-8139-3d4a834c13df-metrics-certs\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.763021 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.763002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgsv\" (UniqueName: \"kubernetes.io/projected/dd6d5222-3146-4542-8139-3d4a834c13df-kube-api-access-lmgsv\") pod \"maas-api-6664b7b778-7xb62\" (UID: \"dd6d5222-3146-4542-8139-3d4a834c13df\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.813851 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.813828    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:57.837960 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.837938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:57.883401 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:57.883339    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112670d1-bddf-4348-ae3e-35a3d8cc8ae4" path="/var/lib/kubelet/pods/112670d1-bddf-4348-ae3e-35a3d8cc8ae4/volumes"
Sep 11 13:02:58.093994 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.093956    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:02:58.095073 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:02:58.095048    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45660449_be86_401c_8c02_996ec846e5bb.slice/crio-e93adc21a035a17160832dc5324f02933deec9f0c58b1144ae074c8755d5713f WatchSource:0}: Error finding container e93adc21a035a17160832dc5324f02933deec9f0c58b1144ae074c8755d5713f: Status 404 returned error can't find the container with id e93adc21a035a17160832dc5324f02933deec9f0c58b1144ae074c8755d5713f
Sep 11 13:02:58.096300 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.096283    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:02:58.122262 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.122231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"]
Sep 11 13:02:58.122622 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:02:58.122595    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6d5222_3146_4542_8139_3d4a834c13df.slice/crio-6380999d416bec3c635f2c241e3ba99c877fbff08e632eb8af50870ea5601cf3 WatchSource:0}: Error finding container 6380999d416bec3c635f2c241e3ba99c877fbff08e632eb8af50870ea5601cf3: Status 404 returned error can't find the container with id 6380999d416bec3c635f2c241e3ba99c877fbff08e632eb8af50870ea5601cf3
Sep 11 13:02:58.713090 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.713057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" event={"ID":"45660449-be86-401c-8c02-996ec846e5bb","Type":"ContainerStarted","Data":"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"}
Sep 11 13:02:58.713483 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.713119    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:02:58.713483 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.713144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" event={"ID":"45660449-be86-401c-8c02-996ec846e5bb","Type":"ContainerStarted","Data":"e93adc21a035a17160832dc5324f02933deec9f0c58b1144ae074c8755d5713f"}
Sep 11 13:02:58.714733 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.714709    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62" event={"ID":"dd6d5222-3146-4542-8139-3d4a834c13df","Type":"ContainerStarted","Data":"814391e538782e59dde0e622552018393a965b7206e0050feee7a514549ff7c4"}
Sep 11 13:02:58.714854 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.714749    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62" event={"ID":"dd6d5222-3146-4542-8139-3d4a834c13df","Type":"ContainerStarted","Data":"6380999d416bec3c635f2c241e3ba99c877fbff08e632eb8af50870ea5601cf3"}
Sep 11 13:02:58.714854 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.714775    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:02:58.734018 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.733960    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" podStartSLOduration=1.243848778 podStartE2EDuration="1.733941129s" totalImagesPullingTime="490.092351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:58.73051122 +0000 UTC m=+2171.374403877" watchObservedRunningTime="2026-09-11 13:02:58.733941129 +0000 UTC m=+2171.377833787"
Sep 11 13:02:58.750465 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:02:58.750423    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62" podStartSLOduration=1.270153795 podStartE2EDuration="1.750409203s" totalImagesPullingTime="480.255408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:02:58.749220912 +0000 UTC m=+2171.393113572" watchObservedRunningTime="2026-09-11 13:02:58.750409203 +0000 UTC m=+2171.394301888"
Sep 11 13:03:04.725525 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:04.725496    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:03:04.725934 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:04.725819    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6664b7b778-7xb62"
Sep 11 13:03:04.795815 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:04.795780    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:03:04.796149 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:04.796113    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" podUID="45660449-be86-401c-8c02-996ec846e5bb" containerName="maas-api" containerID="cri-o://6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530" gracePeriod=30
Sep 11 13:03:05.036369 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.036344    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:03:05.110283 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.110248    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca\") pod \"45660449-be86-401c-8c02-996ec846e5bb\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") "
Sep 11 13:03:05.110283 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.110291    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs\") pod \"45660449-be86-401c-8c02-996ec846e5bb\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") "
Sep 11 13:03:05.110511 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.110338    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggz58\" (UniqueName: \"kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58\") pod \"45660449-be86-401c-8c02-996ec846e5bb\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") "
Sep 11 13:03:05.110511 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.110379    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls\") pod \"45660449-be86-401c-8c02-996ec846e5bb\" (UID: \"45660449-be86-401c-8c02-996ec846e5bb\") "
Sep 11 13:03:05.110651 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.110627    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45660449-be86-401c-8c02-996ec846e5bb" (UID: "45660449-be86-401c-8c02-996ec846e5bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:03:05.112224 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.112203    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "45660449-be86-401c-8c02-996ec846e5bb" (UID: "45660449-be86-401c-8c02-996ec846e5bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:03:05.112340 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.112262    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45660449-be86-401c-8c02-996ec846e5bb" (UID: "45660449-be86-401c-8c02-996ec846e5bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:03:05.112386 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.112362    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58" (OuterVolumeSpecName: "kube-api-access-ggz58") pod "45660449-be86-401c-8c02-996ec846e5bb" (UID: "45660449-be86-401c-8c02-996ec846e5bb"). InnerVolumeSpecName "kube-api-access-ggz58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:03:05.176324 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.176296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:03:05.211145 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.211122    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-maas-api-tls\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:03:05.211145 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.211142    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45660449-be86-401c-8c02-996ec846e5bb-openshift-service-ca\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:03:05.211279 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.211151    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45660449-be86-401c-8c02-996ec846e5bb-metrics-certs\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:03:05.211279 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.211161    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggz58\" (UniqueName: \"kubernetes.io/projected/45660449-be86-401c-8c02-996ec846e5bb-kube-api-access-ggz58\") on node \"ip-10-0-143-248.ec2.internal\" DevicePath \"\""
Sep 11 13:03:05.755244 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.755213    2584 generic.go:356] "Generic (PLEG): container finished" podID="45660449-be86-401c-8c02-996ec846e5bb" containerID="6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530" exitCode=0
Sep 11 13:03:05.755722 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.755276    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"
Sep 11 13:03:05.755722 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.755282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" event={"ID":"45660449-be86-401c-8c02-996ec846e5bb","Type":"ContainerDied","Data":"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"}
Sep 11 13:03:05.755722 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.755328    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm" event={"ID":"45660449-be86-401c-8c02-996ec846e5bb","Type":"ContainerDied","Data":"e93adc21a035a17160832dc5324f02933deec9f0c58b1144ae074c8755d5713f"}
Sep 11 13:03:05.755722 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.755348    2584 scope.go:117] "RemoveContainer" containerID="6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"
Sep 11 13:03:05.764907 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.764890    2584 scope.go:117] "RemoveContainer" containerID="6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"
Sep 11 13:03:05.765225 ip-10-0-143-248 kubenswrapper[2584]: E0911 13:03:05.765199    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530\": container with ID starting with 6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530 not found: ID does not exist" containerID="6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"
Sep 11 13:03:05.765333 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.765236    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530"} err="failed to get container status \"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530\": rpc error: code = NotFound desc = could not find container \"6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530\": container with ID starting with 6b0090341f8a5dab17f07487459be7e98768a8bdd2be1d1145613e6029934530 not found: ID does not exist"
Sep 11 13:03:05.783183 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.783161    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:03:05.786834 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.786812    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-x92pm"]
Sep 11 13:03:05.877381 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:05.877349    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45660449-be86-401c-8c02-996ec846e5bb" path="/var/lib/kubelet/pods/45660449-be86-401c-8c02-996ec846e5bb/volumes"
Sep 11 13:03:11.589481 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:11.589448    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:03:17.194650 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:17.194612    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:03:24.015277 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:24.015240    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w5dp5"]
Sep 11 13:03:27.201238 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:27.201210    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685c8d4ddd-wqnr2_f2f5de07-eed1-419a-bfb6-98d9c430361b/authorino/0.log"
Sep 11 13:03:32.388385 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:32.388355    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tc8tl_89c9caae-8007-400d-908d-bb3d67f2f681/manager/0.log"
Sep 11 13:03:32.496971 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:32.496941    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mqfzv_31f5b960-5c15-40cb-be86-244a5d78df78/manager/0.log"
Sep 11 13:03:32.970093 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:32.970064    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-dgwkc_521dc1f8-c5ca-4435-8f70-474852792e51/copy-manifests/0.log"
Sep 11 13:03:32.977420 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:32.977394    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-dgwkc_521dc1f8-c5ca-4435-8f70-474852792e51/manager/0.log"
Sep 11 13:03:33.556237 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:33.556211    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6664b7b778-7xb62_dd6d5222-3146-4542-8139-3d4a834c13df/maas-api/0.log"
Sep 11 13:03:33.778153 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:33.778126    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818845-c6mqr_61b0435f-b41f-4292-a280-2c535e465b12/cleanup/0.log"
Sep 11 13:03:33.882542 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:33.882471    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818860-mkmlg_46cc126b-f3e4-4d2d-ab7b-0dac99a50e0f/cleanup/0.log"
Sep 11 13:03:34.756493 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:34.756460    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685c8d4ddd-wqnr2_f2f5de07-eed1-419a-bfb6-98d9c430361b/authorino/0.log"
Sep 11 13:03:34.866409 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:34.866368    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-p4ttl_ed763175-dc76-4603-ba43-25e5a8bd3321/manager/0.log"
Sep 11 13:03:34.971412 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:34.971387    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-qzdns_607f683f-430f-461d-80ff-6ead2000ce0f/manager/0.log"
Sep 11 13:03:35.079232 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:35.079155    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b882f_eee0dd69-a0ba-4add-9746-794d09431e72/kuadrant-console-plugin/0.log"
Sep 11 13:03:35.193464 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:35.193425    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lkcwf_312d8ad1-0b76-4b57-bdc6-0c834d915770/manager/0.log"
Sep 11 13:03:35.303398 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:35.303372    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-w5dp5_28d89956-f9b6-4c6c-a640-ba28a60fc801/limitador/0.log"
Sep 11 13:03:35.417114 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:35.417042    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-cqpzd_f58022c2-0212-40bd-9742-c99ee89bb047/manager/0.log"
Sep 11 13:03:35.769644 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:35.769614    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:36.089022 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:36.088952    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67c8b95cc4-v8c4m_5770f6df-8ee9-43bf-8bf6-2869167405e7/kube-auth-proxy/0.log"
Sep 11 13:03:36.205826 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:36.205794    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/1.log"
Sep 11 13:03:42.640833 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.640799    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhplr/must-gather-pmzds"]
Sep 11 13:03:42.641210 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.641161    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45660449-be86-401c-8c02-996ec846e5bb" containerName="maas-api"
Sep 11 13:03:42.641210 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.641172    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="45660449-be86-401c-8c02-996ec846e5bb" containerName="maas-api"
Sep 11 13:03:42.641281 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.641237    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="45660449-be86-401c-8c02-996ec846e5bb" containerName="maas-api"
Sep 11 13:03:42.645321 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.645300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.648131 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.648112    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhplr\"/\"openshift-service-ca.crt\""
Sep 11 13:03:42.648229 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.648132    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rhplr\"/\"default-dockercfg-lbvs9\""
Sep 11 13:03:42.649361 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.649340    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhplr\"/\"kube-root-ca.crt\""
Sep 11 13:03:42.655472 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.655452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/must-gather-pmzds"]
Sep 11 13:03:42.658469 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.658449    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:42.716692 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.716671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzl6k\" (UniqueName: \"kubernetes.io/projected/5deb77a5-b39b-4447-9635-d05b3ce27717-kube-api-access-mzl6k\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.716784 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.716718    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5deb77a5-b39b-4447-9635-d05b3ce27717-must-gather-output\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.730539 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.730518    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log" limit=1024
Sep 11 13:03:42.818140 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.818111    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzl6k\" (UniqueName: \"kubernetes.io/projected/5deb77a5-b39b-4447-9635-d05b3ce27717-kube-api-access-mzl6k\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.818427 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.818402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5deb77a5-b39b-4447-9635-d05b3ce27717-must-gather-output\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.818747 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.818728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5deb77a5-b39b-4447-9635-d05b3ce27717-must-gather-output\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.830663 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.830637    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzl6k\" (UniqueName: \"kubernetes.io/projected/5deb77a5-b39b-4447-9635-d05b3ce27717-kube-api-access-mzl6k\") pod \"must-gather-pmzds\" (UID: \"5deb77a5-b39b-4447-9635-d05b3ce27717\") " pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:42.954822 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:42.954760    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/must-gather-pmzds"
Sep 11 13:03:43.230043 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:43.230008    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/must-gather-pmzds"]
Sep 11 13:03:43.231564 ip-10-0-143-248 kubenswrapper[2584]: W0911 13:03:43.231533    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5deb77a5_b39b_4447_9635_d05b3ce27717.slice/crio-0b394c13f4db34d4d9c32d978fca6fe241b5aa6e2b725c39911789949f6cbf28 WatchSource:0}: Error finding container 0b394c13f4db34d4d9c32d978fca6fe241b5aa6e2b725c39911789949f6cbf28: Status 404 returned error can't find the container with id 0b394c13f4db34d4d9c32d978fca6fe241b5aa6e2b725c39911789949f6cbf28
Sep 11 13:03:43.976891 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:43.976820    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/must-gather-pmzds" event={"ID":"5deb77a5-b39b-4447-9635-d05b3ce27717","Type":"ContainerStarted","Data":"0b394c13f4db34d4d9c32d978fca6fe241b5aa6e2b725c39911789949f6cbf28"}
Sep 11 13:03:44.987360 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:44.987085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/must-gather-pmzds" event={"ID":"5deb77a5-b39b-4447-9635-d05b3ce27717","Type":"ContainerStarted","Data":"2e157d4f3e781091b7a5a610315d1f44701cb4a1e09be53675050da173a27b14"}
Sep 11 13:03:44.987829 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:44.987731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/must-gather-pmzds" event={"ID":"5deb77a5-b39b-4447-9635-d05b3ce27717","Type":"ContainerStarted","Data":"7e1b0e9dad90339fb30f414fb02df6bbd55c60d0ab071e6b006a5f202d75d0b4"}
Sep 11 13:03:45.012110 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:45.012052    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhplr/must-gather-pmzds" podStartSLOduration=2.308990691 podStartE2EDuration="3.01201693s" totalImagesPullingTime="703.026239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:45.008721335 +0000 UTC m=+2217.652613992" watchObservedRunningTime="2026-09-11 13:03:45.01201693 +0000 UTC m=+2217.655909588"
Sep 11 13:03:45.609484 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:45.609456    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-drh5s_bb5a4b25-7707-43ea-aaef-50afeb3fb290/global-pull-secret-syncer/0.log"
Sep 11 13:03:45.730365 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:45.730336    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hr7qd_24f01518-eb66-4676-ae1f-255e1732bb07/konnectivity-agent/0.log"
Sep 11 13:03:45.891866 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:45.891790    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-248.ec2.internal_687ab058f6ce8f763e9516f8b1ddbd13/haproxy/0.log"
Sep 11 13:03:48.435771 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:48.435729    2584 scope.go:117] "RemoveContainer" containerID="fac5e9b9ca6d7fd5b22d4553907dcf79ca52935507da330e9b45aa7be1b7ad8b"
Sep 11 13:03:48.449765 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:48.449726    2584 scope.go:117] "RemoveContainer" containerID="0c5580bf8ae0ce99f7dc20e01247cb013bc3748bbfae4df95e4766201ba143d5"
Sep 11 13:03:49.291341 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.291256    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685c8d4ddd-wqnr2_f2f5de07-eed1-419a-bfb6-98d9c430361b/authorino/0.log"
Sep 11 13:03:49.374043 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.374003    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-p4ttl_ed763175-dc76-4603-ba43-25e5a8bd3321/manager/0.log"
Sep 11 13:03:49.470944 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.470919    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-qzdns_607f683f-430f-461d-80ff-6ead2000ce0f/manager/0.log"
Sep 11 13:03:49.517729 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.517696    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b882f_eee0dd69-a0ba-4add-9746-794d09431e72/kuadrant-console-plugin/0.log"
Sep 11 13:03:49.559407 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.559325    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lkcwf_312d8ad1-0b76-4b57-bdc6-0c834d915770/manager/0.log"
Sep 11 13:03:49.595233 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.595208    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-w5dp5_28d89956-f9b6-4c6c-a640-ba28a60fc801/limitador/0.log"
Sep 11 13:03:49.671533 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:49.671490    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-cqpzd_f58022c2-0212-40bd-9742-c99ee89bb047/manager/0.log"
Sep 11 13:03:51.693124 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:51.693093    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/node-exporter/0.log"
Sep 11 13:03:51.715914 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:51.715813    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/kube-rbac-proxy/0.log"
Sep 11 13:03:51.741128 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:51.741101    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dm2mj_69712a13-509d-439b-a9f6-43dc2bf30170/init-textfile/0.log"
Sep 11 13:03:52.268676 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:52.268647    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857476fcf9-fknx4_6c51f7ed-b168-4792-b0a7-18879d202de9/telemeter-client/0.log"
Sep 11 13:03:52.294388 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:52.294353    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857476fcf9-fknx4_6c51f7ed-b168-4792-b0a7-18879d202de9/reload/0.log"
Sep 11 13:03:52.322351 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:52.322302    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857476fcf9-fknx4_6c51f7ed-b168-4792-b0a7-18879d202de9/kube-rbac-proxy/0.log"
Sep 11 13:03:54.104675 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:54.104637    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-89nf9_8997d8d1-043e-492b-a884-18a1ecfeb61c/networking-console-plugin/0.log"
Sep 11 13:03:55.239614 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.239585    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc744f876-jgnwm_18cecaf8-ca75-4efd-83ab-1f2fcb22ab04/console/0.log"
Sep 11 13:03:55.274769 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.274733    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-7ndqx_3d91683a-6f12-410f-8ced-0544c779b5f3/download-server/0.log"
Sep 11 13:03:55.370934 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.370891    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"]
Sep 11 13:03:55.373921 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.373899    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.391115 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.391087    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"]
Sep 11 13:03:55.446272 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.446239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-sys\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.446462 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.446434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcqz\" (UniqueName: \"kubernetes.io/projected/1906951f-1ff7-416a-a65f-c3595e500517-kube-api-access-hdcqz\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.446537 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.446483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-podres\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.446594 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.446554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-lib-modules\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.446594 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.446579    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-proc\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547175 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-lib-modules\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547175 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-proc\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-sys\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547239    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-lib-modules\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcqz\" (UniqueName: \"kubernetes.io/projected/1906951f-1ff7-416a-a65f-c3595e500517-kube-api-access-hdcqz\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-sys\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-podres\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547247    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-proc\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.547406 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.547397    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1906951f-1ff7-416a-a65f-c3595e500517-podres\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.556905 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.556881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcqz\" (UniqueName: \"kubernetes.io/projected/1906951f-1ff7-416a-a65f-c3595e500517-kube-api-access-hdcqz\") pod \"perf-node-gather-daemonset-4bmt4\" (UID: \"1906951f-1ff7-416a-a65f-c3595e500517\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.689418 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.689379    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:55.988841 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:55.988810    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"]
Sep 11 13:03:56.027841 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:56.027810    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-m4ksr_cc882b4a-ec80-4df3-9780-3695d551267b/volume-data-source-validator/0.log"
Sep 11 13:03:56.151690 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:56.151661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4" event={"ID":"1906951f-1ff7-416a-a65f-c3595e500517","Type":"ContainerStarted","Data":"94a7bde9db506fcb43217499de345fa3f4a298947cfba97229509fefbb853bdf"}
Sep 11 13:03:56.151888 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:56.151868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4" event={"ID":"1906951f-1ff7-416a-a65f-c3595e500517","Type":"ContainerStarted","Data":"a84a0787293251632b4c2951b5373fa0bf950e2b4ba7e8cea3b5955c025f5214"}
Sep 11 13:03:56.152058 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:56.152017    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:03:56.172641 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:56.172582    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4" podStartSLOduration=1.172560328 podStartE2EDuration="1.172560328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:56.170325836 +0000 UTC m=+2228.814218494" watchObservedRunningTime="2026-09-11 13:03:56.172560328 +0000 UTC m=+2228.816452989"
Sep 11 13:03:57.202926 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:57.202885    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l89gq_8a027594-40cf-47c3-80e9-11d4a4fa2239/dns/0.log"
Sep 11 13:03:57.232162 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:57.232134    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l89gq_8a027594-40cf-47c3-80e9-11d4a4fa2239/kube-rbac-proxy/0.log"
Sep 11 13:03:57.347830 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:57.347794    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cq4jq_01a582d3-2efd-40bb-bbee-42177f734634/dns-node-resolver/0.log"
Sep 11 13:03:57.920934 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:57.920900    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-989g7_46166e53-54cb-485d-a443-6f099b77498f/node-ca/0.log"
Sep 11 13:03:59.168767 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:59.168738    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67c8b95cc4-v8c4m_5770f6df-8ee9-43bf-8bf6-2869167405e7/kube-auth-proxy/0.log"
Sep 11 13:03:59.201905 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:59.201876    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/0.log"
Sep 11 13:03:59.211270 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:03:59.211247    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/1.log"
Sep 11 13:04:00.222697 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.222669    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw6mm_bb6265ee-2d15-43e6-b7e4-e0e28eb01388/serve-healthcheck-canary/0.log"
Sep 11 13:04:00.713328 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.713301    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5cb65_1b3f976d-9792-4e0b-86a2-2389fbb41ebc/insights-operator/0.log"
Sep 11 13:04:00.715218 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.715192    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5cb65_1b3f976d-9792-4e0b-86a2-2389fbb41ebc/insights-operator/1.log"
Sep 11 13:04:00.871376 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.871349    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzdjd_ae144019-341c-4807-8332-29f6161af077/kube-rbac-proxy/0.log"
Sep 11 13:04:00.890759 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.890725    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzdjd_ae144019-341c-4807-8332-29f6161af077/exporter/0.log"
Sep 11 13:04:00.911220 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:00.911187    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzdjd_ae144019-341c-4807-8332-29f6161af077/extractor/0.log"
Sep 11 13:04:02.167967 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:02.167938    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-4bmt4"
Sep 11 13:04:02.968912 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:02.968882    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tc8tl_89c9caae-8007-400d-908d-bb3d67f2f681/manager/0.log"
Sep 11 13:04:03.178632 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:03.178598    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mqfzv_31f5b960-5c15-40cb-be86-244a5d78df78/manager/0.log"
Sep 11 13:04:03.409004 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:03.408971    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-dgwkc_521dc1f8-c5ca-4435-8f70-474852792e51/manager/0.log"
Sep 11 13:04:03.433630 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:03.433602    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-dgwkc_521dc1f8-c5ca-4435-8f70-474852792e51/copy-manifests/0.log"
Sep 11 13:04:05.341132 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:05.341099    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67c8b95cc4-v8c4m_5770f6df-8ee9-43bf-8bf6-2869167405e7/kube-auth-proxy/0.log"
Sep 11 13:04:05.363822 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:05.363792    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/0.log"
Sep 11 13:04:05.373269 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:05.373225    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/1.log"
Sep 11 13:04:07.092797 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:07.092718    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67c8b95cc4-v8c4m_5770f6df-8ee9-43bf-8bf6-2869167405e7/kube-auth-proxy/0.log"
Sep 11 13:04:07.116900 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:07.116873    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/0.log"
Sep 11 13:04:07.125970 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:07.125933    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8pcrm_509ded33-17ab-44f0-b1b4-b79229f85a18/istio-proxy/1.log"
Sep 11 13:04:10.244742 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:10.244673    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-q5dll_b116c624-3915-473b-8932-70a802b8527d/kube-storage-version-migrator-operator/1.log"
Sep 11 13:04:10.245810 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:10.245789    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-q5dll_b116c624-3915-473b-8932-70a802b8527d/kube-storage-version-migrator-operator/0.log"
Sep 11 13:04:11.315476 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:11.315445    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-25h7k_ff43cf92-ce90-4553-a63a-6f814adf91e4/kube-multus/0.log"
Sep 11 13:04:12.010445 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:12.010406    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvqw4_a5f79f29-400f-49f9-b359-0d77dc97edd9/kube-multus-additional-cni-plugins/0.log"
Sep 11 13:04:12.050370 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:12.050329    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvqw4_a5f79f29-400f-49f9-b359-0d77dc97edd9/egress-router-binary-copy/0.log"
Sep 11 13:04:12.088076 ip-10-0-143-248 kubenswrapper[2584]: I0911 13:04:12.088022    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvqw4_a5f79f29-400f-49f9-b359-0d77dc97edd9/cni-plugins/0.log"