Sep 11 13:17:40.252039 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 13:17:40.252051 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 13:17:40.252058 ip-10-0-132-92 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 13:17:40.252198 ip-10-0-132-92 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 13:17:50.501639 ip-10-0-132-92 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 13:17:50.501655 ip-10-0-132-92 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 47d7c4a730314a7cb98c14dd9ca7308f --
Sep 11 13:19:46.053777 ip-10-0-132-92 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 13:19:46.455114 ip-10-0-132-92 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:46.455114 ip-10-0-132-92 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 13:19:46.455114 ip-10-0-132-92 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:46.455114 ip-10-0-132-92 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 13:19:46.455114 ip-10-0-132-92 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:46.456086 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.456005    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 13:19:46.460263 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460246    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.460263 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460263    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460267    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460270    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460273    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460276    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460279    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460282    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460285    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460288    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460291    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460294    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460297    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460299    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460302    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460304    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460307    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460310    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460312    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460315    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460324    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.460329 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460327    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460330    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460332    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460335    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460342    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460345    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460348    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460350    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460353    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460356    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460358    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460361    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460364    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460366    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460369    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460371    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460380    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460384    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460387    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.460833 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460389    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460392    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460394    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460397    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460400    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460402    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460404    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460407    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460410    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460412    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460415    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460419    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460423    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460426    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460429    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460432    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460435    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460438    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460441    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460444    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.461304 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460446    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460449    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460452    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460455    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460457    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460459    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460462    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460465    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460467    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460470    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460472    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460475    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460478    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460480    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460483    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460485    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460488    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460491    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460493    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460513    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.461820 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460517    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460520    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460522    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460525    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460528    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460531    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460533    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460536    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460539    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460542    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460545    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460548    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460550    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460553    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460556    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460560    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460563    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460566    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.460569    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.462315 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461273    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461281    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461284    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461287    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461289    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461292    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461294    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461298    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461301    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461303    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461306    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461309    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461312    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461315    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461319    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461322    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461326    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461331    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461335    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.462797 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461338    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461342    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461345    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461348    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461352    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461355    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461358    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461360    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461363    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461366    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461368    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461371    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461374    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461376    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461379    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461381    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461384    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461386    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461389    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461392    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.463265 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461394    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461397    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461399    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461402    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461404    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461406    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461409    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461412    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461414    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461417    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461420    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461422    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461425    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461428    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461431    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461434    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461436    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461439    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461441    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461445    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.463766 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461448    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461451    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461454    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461457    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461460    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461462    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461465    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461468    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461470    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461473    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461475    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461477    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461480    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461483    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461485    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461488    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461490    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461493    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461495    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.464279 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461513    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461520    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461522    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461525    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461528    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461530    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461534    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461536    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461539    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461541    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461544    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461547    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461549    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461552    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461554    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461557    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461560    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461562    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461565    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461568    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.464765 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461570    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461932    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461937    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461940    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461942    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461945    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461947    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461950    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461953    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461955    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461958    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461960    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461963    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461966    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461969    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461972    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461974    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461977    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461980    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461982    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.465256 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461985    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461987    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461991    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461993    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461996    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.461999    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462001    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462004    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462007    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462009    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462012    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462014    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462016    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462019    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462021    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462023    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462028    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462031    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.465795 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462033    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462036    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462038    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462041    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462043    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462046    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462048    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462051    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462054    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462057    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462059    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462063    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462067    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462070    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462072    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462075    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462077    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462080    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462082    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.466261 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462085    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462087    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462090    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462092    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462095    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462097    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462100    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462102    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462105    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462107    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462110    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462115    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462118    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462121    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462124    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462126    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462129    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462132    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462134    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462137    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.466737 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462139    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462143    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462145    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462148    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462150    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462153    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462157    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462160    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462163    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462166    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462168    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462171    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462173    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462176    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462178    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462181    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462183    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462188    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462191    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462193    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.467259 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462196    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462198    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462271    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462304    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462311    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462316    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462320    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462323    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462327    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462331    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462334    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462337    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462340    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462343    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462347    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462350    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462355    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462358    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462362    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462364    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462368    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462371    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462374    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 13:19:46.467769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462378    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462381    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462384    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462387    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462390    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462393    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462398    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462400    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462403    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462407    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462410    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462414    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462416    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462419    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462422    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462425    2582 flags.go:64] FLAG: --enable-server="true"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462428    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462433    2582 flags.go:64] FLAG: --event-burst="100"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462436    2582 flags.go:64] FLAG: --event-qps="50"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462439    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462442    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462445    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462448    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462451    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462455    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 13:19:46.468352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462459    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462462    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462465    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462468    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462470    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462473    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462476    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462479    2582 flags.go:64] FLAG: --feature-gates=""
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462483    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462486    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462489    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462492    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462495    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462514    2582 flags.go:64] FLAG: --help="false"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462518    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462521    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462524    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462527    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462530    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462534    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462537    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462539    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462542    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 13:19:46.469046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462545    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462548    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462551    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462554    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462556    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462559    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462562    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462565    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462567    2582 flags.go:64] FLAG: --lock-file=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462573    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462576    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462579    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462584    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462587    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462590    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462592    2582 flags.go:64] FLAG: --logging-format="text"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462595    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462598    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462601    2582 flags.go:64] FLAG: --manifest-url=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462604    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462608    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462612    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462617    2582 flags.go:64] FLAG: --max-pods="110"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462620    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462623    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 13:19:46.469724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462626    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462629    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462632    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462635    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462638    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462645    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462648    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462651    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462654    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462657    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462662    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462665    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462668    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462671    2582 flags.go:64] FLAG: --port="10250"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462674    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462677    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0198c89179fe18c78"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462680    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462685    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462688    2582 flags.go:64] FLAG: --register-node="true"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462690    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462694    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462697    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462700    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462703    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462706    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 13:19:46.470398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462709    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462712    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462715    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462718    2582 flags.go:64] FLAG: --runonce="false"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462722    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462725    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462728    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462731    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462734    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462737    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462740    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462743    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462746    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462749    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462751    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462754    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462757    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462760    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462763    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462768    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462771    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462774    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462778    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462781    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462785    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 13:19:46.471240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462788    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462792    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462795    2582 flags.go:64] FLAG: --v="2"
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462799    2582 flags.go:64] FLAG: --version="false"
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462803    2582 flags.go:64] FLAG: --vmodule=""
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462806    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.462810    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462927    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462931    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462934    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462938    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462942    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462946    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462948    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462951    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462954    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462956    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462959    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462962    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462965    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462967    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.471943 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462970    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462972    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462975    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462977    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462980    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462982    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462986    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462990    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462992    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.462996    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463002    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463005    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463008    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463011    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463014    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463017    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463020    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463023    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463025    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.472617 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463028    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463031    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463033    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463037    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463040    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463043    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463045    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463048    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463051    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463053    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463056    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463058    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463060    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463063    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463066    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463069    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463071    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463074    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463076    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463080    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.473135 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463084    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463087    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463090    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463094    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463097    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463100    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463103    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463105    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463108    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463110    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463113    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463115    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463118    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463121    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463123    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463128    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463131    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463133    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463136    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.473657 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463138    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463141    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463144    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463146    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463149    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463151    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463154    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463156    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463159    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463162    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463164    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463167    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463169    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463172    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463174    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463177    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463181    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463183    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463186    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463189    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.474124 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463192    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463194    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463197    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463200    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463202    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463205    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.463207    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.463218    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.470328    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.470342    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.471176    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.471186    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471256    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471261    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471264    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.474646 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471267    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471270    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471273    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471276    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471279    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471281    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471284    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471287    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471289    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471292    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471295    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471298    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471300    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471303    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471308    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471311    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471315    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471318    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471320    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471323    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.475065 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471326    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471329    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471332    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471335    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471337    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471340    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471344    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471346    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471349    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471353    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471357    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471360    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471362    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471365    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471367    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471370    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471373    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471375    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471378    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.475561 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471380    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471383    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471386    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471388    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471391    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471393    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471397    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471401    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471403    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471406    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471408    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471411    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471414    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471416    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471419    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471421    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471424    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471426    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471429    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471432    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.476035 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471434    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471437    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471440    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471442    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471444    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471447    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471450    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471452    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471455    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471457    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471460    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471462    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471465    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471468    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471470    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471473    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471476    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471478    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471481    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.476581 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471484    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471486    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471489    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471492    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471494    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471509    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471512    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471515    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471518    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471520    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471523    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471526    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471528    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471531    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471534    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471537    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471540    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.477045 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471543    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.471548    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471655    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471660    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471663    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471665    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471668    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471671    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471674    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471677    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471680    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471683    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471686    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471688    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471691    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:46.477457 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471695    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471699    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471701    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471704    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471706    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471709    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471711    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471714    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471717    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471720    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471722    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471725    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471727    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471730    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471732    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471735    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471738    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471740    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471743    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471745    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:46.477835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471748    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471750    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471753    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471755    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471758    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471760    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471763    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471765    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471768    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471770    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471773    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471775    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471778    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471780    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471783    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471786    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471788    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471791    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471793    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471796    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:46.478323 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471799    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471801    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471804    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471806    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471809    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471811    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471813    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471816    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471819    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471821    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471824    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471826    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471830    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471833    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471836    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471839    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471841    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471844    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471846    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:46.478821 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471849    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471851    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471854    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471856    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471858    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471861    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471866    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471868    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471871    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471873    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471876    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471878    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471881    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471884    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471887    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471891    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471894    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471897    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471900    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:46.479283 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471903    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471906    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471909    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471912    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471915    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471918    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471920    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:46.471923    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.471928    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.472025    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.474007    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.475282    2582 server.go:1019] "Starting client certificate rotation"
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.475378    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 13:19:46.479749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.475415    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 13:19:46.480067 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.478198    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 13:19:46.480691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.480673    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 13:19:46.491455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.491431    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 11 13:19:46.495492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.495476    2582 log.go:25] "Validated CRI v1 image API"
Sep 11 13:19:46.496302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.496286    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 13:19:46.499630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.499610    2582 fs.go:135] Filesystem UUIDs: map[5fe1b981-7a84-4bc5-aba7-5cfc7ae005da:/dev/nvme0n1p3 6cab5461-33f7-4a2d-bf56-99bb105ed9de:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 11 13:19:46.499705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.499629    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 13:19:46.504725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.504618    2582 manager.go:216] Machine: {Timestamp:2026-09-11 13:19:46.503172919 +0000 UTC m=+0.335608049 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095499 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b5cb3a442f39a47d15a951e157da SystemUUID:ec24b5cb-3a44-2f39-a47d-15a951e157da BootID:47d7c4a7-3031-4a7c-b98c-14dd9ca7308f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:07:50:8c:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:07:50:8c:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:15:2e:2a:84:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 13:19:46.504725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.504717    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 13:19:46.504880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.504814    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 13:19:46.508023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.507997    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 13:19:46.508157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.508024    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 13:19:46.509781 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.509770    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 13:19:46.509815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.509784    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 13:19:46.509815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.509792    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 13:19:46.509815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.509806    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 13:19:46.510613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.510603    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 13:19:46.514038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514026    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 13:19:46.514145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514136    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 13:19:46.514187 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514168    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 13:19:46.514187 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514177    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 13:19:46.514254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514190    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 13:19:46.514254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514202    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 11 13:19:46.514254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514211    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 13:19:46.514576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514562    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 13:19:46.514611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.514591    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 13:19:46.519355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.519329    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 13:19:46.522046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.522028    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 13:19:46.522115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.522065    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 13:19:46.524471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524458    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524478    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524484    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524489    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524514    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524520    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524533    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 13:19:46.524540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524538    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 13:19:46.524722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524549    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 13:19:46.524722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524555    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 13:19:46.524722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524563    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 13:19:46.524722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.524569    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 13:19:46.525445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.525437    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 13:19:46.525445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.525445    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 13:19:46.529146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.529123    2582 server.go:1268] "Started kubelet"
Sep 11 13:19:46.529222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.529194    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 13:19:46.529282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.529217    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 13:19:46.529335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.529284    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 13:19:46.530045 ip-10-0-132-92 systemd[1]: Started Kubernetes Kubelet.
Sep 11 13:19:46.531238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.531218    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 13:19:46.533775 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.533742    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 13:19:46.534316 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.534297    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 13:19:46.535019 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.535002    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 13:19:46.535375 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.535349    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 13:19:46.536630 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.536455    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 13:19:46.536811 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.536790    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 13:19:46.538423 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.537543    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca45124b92  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.529094546 +0000 UTC m=+0.361529677,LastTimestamp:2026-09-11 13:19:46.529094546 +0000 UTC m=+0.361529677,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.540881 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.540861    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 13:19:46.541561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.541544    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 13:19:46.541702 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.541681    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:46.542163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542142    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 13:19:46.542163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542163    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 13:19:46.542261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542220    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 13:19:46.542261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542230    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 13:19:46.542261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542237    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 13:19:46.542364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542270    2582 factory.go:55] Registering systemd factory
Sep 11 13:19:46.542364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542281    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 11 13:19:46.542484 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542471    2582 factory.go:153] Registering CRI-O factory
Sep 11 13:19:46.542542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542490    2582 factory.go:223] Registration of the crio container factory successfully
Sep 11 13:19:46.542577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542557    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 13:19:46.542625 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542577    2582 factory.go:103] Registering Raw factory
Sep 11 13:19:46.542625 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.542591    2582 manager.go:1196] Started watching for new ooms in manager
Sep 11 13:19:46.543023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.543009    2582 manager.go:349] Starting recovery of all containers
Sep 11 13:19:46.553702 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.553683    2582 manager.go:354] Recovery completed
Sep 11 13:19:46.555540 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.555211    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 13:19:46.555891 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.555872    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 13:19:46.557136 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.557113    2582 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 13:19:46.560435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.560422    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.561792 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.561777    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.561846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.561810    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.561846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.561823    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.562366 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.562345    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 13:19:46.562366 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.562360    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 13:19:46.562496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.562377    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 13:19:46.562496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.562379    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.563069 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563053    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.563149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563081    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.563149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563095    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.563799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563782    2582 policy_none.go:49] "None policy: Start"
Sep 11 13:19:46.563861 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563805    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 13:19:46.563861 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.563823    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 13:19:46.565442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.565315    2582 policy_none.go:47] "Start"
Sep 11 13:19:46.572648 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.572572    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca47053cce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.56179323 +0000 UTC m=+0.394228363,LastTimestamp:2026-09-11 13:19:46.56179323 +0000 UTC m=+0.394228363,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.577278 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.577213    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca47059a9c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.561817244 +0000 UTC m=+0.394252373,LastTimestamp:2026-09-11 13:19:46.561817244 +0000 UTC m=+0.394252373,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.585924 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.585862    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca4705c1c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.561827273 +0000 UTC m=+0.394262402,LastTimestamp:2026-09-11 13:19:46.561827273 +0000 UTC m=+0.394262402,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.591073 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591059    2582 manager.go:337] "Starting Device Plugin manager"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.591104    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591116    2582 server.go:87] "Starting device plugin registration server"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591394    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591404    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591511    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591593    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.591601    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.592568    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.592619    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.597624    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-92.ec2.internal.18d446ca47053cce\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca47053cce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.56179323 +0000 UTC m=+0.394228363,LastTimestamp:2026-09-11 13:19:46.563066164 +0000 UTC m=+0.395501294,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.609191    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-92.ec2.internal.18d446ca47059a9c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca47059a9c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.561817244 +0000 UTC m=+0.394252373,LastTimestamp:2026-09-11 13:19:46.563087833 +0000 UTC m=+0.395522967,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.613669    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsr9x"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.619091    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-92.ec2.internal.18d446ca4705c1c9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca4705c1c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.561827273 +0000 UTC m=+0.394262402,LastTimestamp:2026-09-11 13:19:46.56310087 +0000 UTC m=+0.395536004,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.629675    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca49d49d71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.608938353 +0000 UTC m=+0.441373481,LastTimestamp:2026-09-11 13:19:46.608938353 +0000 UTC m=+0.441373481,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.629789    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsr9x"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.691514    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.692340    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.703321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.692364    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.704274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.692376    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.704274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.692404    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.704274 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.702806    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-92.ec2.internal.18d446ca47053cce\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-92.ec2.internal.18d446ca47053cce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-92.ec2.internal,UID:ip-10-0-132-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-92.ec2.internal,},FirstTimestamp:2026-09-11 13:19:46.56179323 +0000 UTC m=+0.394228363,LastTimestamp:2026-09-11 13:19:46.69234965 +0000 UTC m=+0.524784780,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-92.ec2.internal,}"
Sep 11 13:19:46.715287 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.715233    2582 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.764364 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.764345    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.844315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.844279    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 13:19:46.845493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.845472    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 13:19:46.845578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.845541    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 13:19:46.845578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.845566    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 13:19:46.845669 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.845647    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 13:19:46.849393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.849373    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:46.915494 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.915476    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.916251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.916237    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.916317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.916264    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.916317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.916278    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.916317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.916304    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.944197 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.944176    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.944281 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.944199    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-92.ec2.internal\": node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:46.946352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.946328    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"]
Sep 11 13:19:46.946398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.946394    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.947171 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.947155    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.947231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.947182    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.947231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.947200    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.948618 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.948604    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.948772 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.948757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.948839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.948787    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.949364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949346    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.949449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949353    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.949449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949400    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.949449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949413    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.949449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949376    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.949624 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.949470    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.950774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.950757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.950849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.950783    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:46.951429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.951412    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:46.951534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.951440    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:46.951534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:46.951454    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:46.969123 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.969084    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:46.970021 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.970006    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:46.973378 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:46.973363    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-92.ec2.internal\" not found" node="ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.043740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.043717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.043833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.043759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7dd1428d7a8ed86935288a6878be4d6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"7dd1428d7a8ed86935288a6878be4d6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.043833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.043810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.070187 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.070169    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.144577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.144651 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.144651 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7dd1428d7a8ed86935288a6878be4d6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"7dd1428d7a8ed86935288a6878be4d6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.144713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.144713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d41796751870c4f41ab3eee2b4a394d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal\" (UID: \"d41796751870c4f41ab3eee2b4a394d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.144773 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.144728    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7dd1428d7a8ed86935288a6878be4d6d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-92.ec2.internal\" (UID: \"7dd1428d7a8ed86935288a6878be4d6d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.171265 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.171243    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.272124 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.272069    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.273179 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.273154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.275706 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.275684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.373362 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.373331    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.473673 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.473635    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.474750 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.474732    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 13:19:47.474888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.474869    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 13:19:47.576276 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:47.574616    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-92.ec2.internal\" not found"
Sep 11 13:19:47.587725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.587706    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:47.642488 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.642461    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:47.705649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.705614    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 13:14:47 +0000 UTC" deadline="2028-06-07 00:18:27.679494272 +0000 UTC"
Sep 11 13:19:47.705649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.705647    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15226h58m39.973850276s"
Sep 11 13:19:47.742207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.742189    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.757043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.757025    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 13:19:47.759280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.759266    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal"
Sep 11 13:19:47.778669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.778643    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 13:19:47.862001 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:47.861970    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41796751870c4f41ab3eee2b4a394d8.slice/crio-d589e850f713575580d3733d19a7cbfdada03a15526dfa76528f9a2c958072a2 WatchSource:0}: Error finding container d589e850f713575580d3733d19a7cbfdada03a15526dfa76528f9a2c958072a2: Status 404 returned error can't find the container with id d589e850f713575580d3733d19a7cbfdada03a15526dfa76528f9a2c958072a2
Sep 11 13:19:47.868000 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:47.867981    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd1428d7a8ed86935288a6878be4d6d.slice/crio-8df731edebefbcc4d10d88804644b0bd207754b7c3b4e4aafeefc22593ddb590 WatchSource:0}: Error finding container 8df731edebefbcc4d10d88804644b0bd207754b7c3b4e4aafeefc22593ddb590: Status 404 returned error can't find the container with id 8df731edebefbcc4d10d88804644b0bd207754b7c3b4e4aafeefc22593ddb590
Sep 11 13:19:47.868114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:47.868101    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:19:48.001906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.001883    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:48.516070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.516026    2582 apiserver.go:52] "Watching apiserver"
Sep 11 13:19:48.522345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.522311    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 13:19:48.524026 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.523996    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kwxvx","kube-system/konnectivity-agent-6fmz4","kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb","openshift-dns/node-resolver-c5kb6","openshift-image-registry/node-ca-wx27l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal","openshift-multus/multus-kkrqm","openshift-multus/network-metrics-daemon-vjjx9","kube-system/global-pull-secret-syncer-csggs","openshift-cluster-node-tuning-operator/tuned-dk9r8","openshift-multus/multus-additional-cni-plugins-qh66g","openshift-network-diagnostics/network-check-target-f4z5l","openshift-network-operator/iptables-alerter-g2cz9"]
Sep 11 13:19:48.525593 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.525570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.525708 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.525663    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:48.526878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.526853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:48.526970 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.526949    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:48.528241 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.528220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.529726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.529701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.530997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.530973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.532512 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.532493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.532784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.532750    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.533069 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.533016    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.533815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.533794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.533907 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.533871    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:48.533973 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.533950    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tnvj2\""
Sep 11 13:19:48.534078 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.534028    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 13:19:48.534078 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.534059    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 13:19:48.534215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.534201    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.534355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.534307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.534355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.534341    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mc9b\""
Sep 11 13:19:48.535454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.535432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.536931 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.536911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.537739 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.537700    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.537943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.537913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.537943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.537938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4b6fr\""
Sep 11 13:19:48.538218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.538197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 13:19:48.538284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.538259    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2q9k5\""
Sep 11 13:19:48.538426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.538408    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.538706 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.538687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.540623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.540216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.541024 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.541008    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 13:19:48.541863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.541844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.543531 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.543503    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 13:19:48.547131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547108    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sk2t2\""
Sep 11 13:19:48.547230 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547174    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 13:19:48.547403 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547377    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.547546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 13:19:48.547614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547600    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.547711 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.547381    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 13:19:48.551970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.551938    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 13:19:48.552269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552246    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8v24g\""
Sep 11 13:19:48.552353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 13:19:48.552353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.552501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-socket-dir-parent\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.552501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-systemd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.552501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-env-overrides\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.552501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-systemd\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.552501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552493    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-iptables-alerter-script\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-socket-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552528    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552534    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b3160f1-4933-46df-adff-207d0becf29a-serviceca\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552611    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-km84p\""
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-k8s-cni-cncf-io\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.552767 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-multus-certs\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.553077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.553077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552799    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.553077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552903    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kfjg5\""
Sep 11 13:19:48.553280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553089    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 13:19:48.553280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553108    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 13:19:48.553280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553128    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 13:19:48.553280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.553280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7h5kz\""
Sep 11 13:19:48.553470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553355    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 13:19:48.553470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553433    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:19:48.553470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.552802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.553568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-etc-selinux\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.553568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553516    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 13:19:48.553568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-cni-binary-copy\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.553690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-multus\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.553690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-kubelet\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.553690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.553839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.553839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-log-socket\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.553839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rcb\" (UniqueName: \"kubernetes.io/projected/5b3160f1-4933-46df-adff-207d0becf29a-kube-api-access-w5rcb\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.553839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-systemd-units\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-netd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-script-lib\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.553963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-sys\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fkx6\" (UniqueName: \"kubernetes.io/projected/6852d9c7-763e-4350-843e-642056433451-kube-api-access-8fkx6\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-registration-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-system-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-bin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8879b2c-2e02-422e-aea0-3c32776bb894-hosts-file\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-var-lib-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-bin\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-dbus\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.554363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:48.554631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-kubernetes\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-lib-modules\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-netns\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.554631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrxc\" (UniqueName: \"kubernetes.io/projected/b8705b71-b07b-41bc-8b35-62d8771d19fb-kube-api-access-nhrxc\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.554834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8879b2c-2e02-422e-aea0-3c32776bb894-tmp-dir\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.554834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-etc-tuned\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.554985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjgts\" (UniqueName: \"kubernetes.io/projected/1a5a8088-1a8a-4a62-a249-b4529b060c21-kube-api-access-vjgts\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.554985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-agent-certs\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.554985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-slash\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.554985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.554965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-ovn\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.555207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-modprobe-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.555207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-host\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.555207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-cnibin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.555207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-conf\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.555207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrtt\" (UniqueName: \"kubernetes.io/projected/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-kube-api-access-kgrtt\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-daemon-config\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4vx\" (UniqueName: \"kubernetes.io/projected/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-kube-api-access-sj4vx\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b3160f1-4933-46df-adff-207d0becf29a-host\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-kubelet\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-netns\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.555501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.555949 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-config\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.555949 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-tmp\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.555949 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-hostroot\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.556111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.555983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-kubelet-config\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.556111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-konnectivity-ca\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.556215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.556215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ctlr\" (UniqueName: \"kubernetes.io/projected/706a3149-c72c-4f7d-b142-741940059d70-kube-api-access-7ctlr\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.556325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysconfig\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.556325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.556325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-run\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.556501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-var-lib-kubelet\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.556501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-sys-fs\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.556501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-conf-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.556501 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rjd\" (UniqueName: \"kubernetes.io/projected/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-kube-api-access-42rjd\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf2t\" (UniqueName: \"kubernetes.io/projected/b8879b2c-2e02-422e-aea0-3c32776bb894-kube-api-access-mbf2t\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-etc-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-node-log\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/706a3149-c72c-4f7d-b142-741940059d70-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-host-slash\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.556737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-device-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.557011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-etc-kubernetes\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.557011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cnibin\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.557011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.556822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.567542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.566907    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 13:19:48.611107 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.611082    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnl5r"
Sep 11 13:19:48.626421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.626401    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnl5r"
Sep 11 13:19:48.657242 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-sys-fs\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.657377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-conf-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.657377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-conf-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.657377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-sys-fs\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.657542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rjd\" (UniqueName: \"kubernetes.io/projected/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-kube-api-access-42rjd\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.657542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf2t\" (UniqueName: \"kubernetes.io/projected/b8879b2c-2e02-422e-aea0-3c32776bb894-kube-api-access-mbf2t\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.657542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-etc-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.657542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-node-log\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.657542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/706a3149-c72c-4f7d-b142-741940059d70-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-host-slash\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-device-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-etc-kubernetes\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cnibin\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657738    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-etc-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-socket-dir-parent\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.657790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-systemd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cnibin\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-env-overrides\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-etc-kubernetes\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-systemd\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657861    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-socket-dir-parent\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-iptables-alerter-script\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-device-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-socket-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b3160f1-4933-46df-adff-207d0becf29a-serviceca\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-host-slash\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.657998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-k8s-cni-cncf-io\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-systemd\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-multus-certs\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.658369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-etc-selinux\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-cni-binary-copy\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-multus\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-node-log\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-socket-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-kubelet\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658177    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-kubelet\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-systemd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-etc-selinux\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-log-socket\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rcb\" (UniqueName: \"kubernetes.io/projected/5b3160f1-4933-46df-adff-207d0becf29a-kube-api-access-w5rcb\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-systemd-units\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-netd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.659231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-script-lib\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-sys\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fkx6\" (UniqueName: \"kubernetes.io/projected/6852d9c7-763e-4350-843e-642056433451-kube-api-access-8fkx6\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-registration-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-system-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-bin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-k8s-cni-cncf-io\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-bin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8879b2c-2e02-422e-aea0-3c32776bb894-hosts-file\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-var-lib-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b3160f1-4933-46df-adff-207d0becf29a-serviceca\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-bin\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-dbus\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-kubernetes\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.660236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-cni-binary-copy\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-var-lib-cni-multus\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-multus-certs\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-lib-modules\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-netns\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrxc\" (UniqueName: \"kubernetes.io/projected/b8705b71-b07b-41bc-8b35-62d8771d19fb-kube-api-access-nhrxc\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8879b2c-2e02-422e-aea0-3c32776bb894-tmp-dir\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.658963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8879b2c-2e02-422e-aea0-3c32776bb894-hosts-file\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-etc-tuned\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-var-lib-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjgts\" (UniqueName: \"kubernetes.io/projected/1a5a8088-1a8a-4a62-a249-b4529b060c21-kube-api-access-vjgts\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-bin\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-lib-modules\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-agent-certs\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-env-overrides\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.661150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-slash\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-slash\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-cni-netd\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659220    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-dbus\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.659294    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.659389    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:49.159349203 +0000 UTC m=+2.991784344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-log-socket\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-kubernetes\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-ovn\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-ovn\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-modprobe-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-host-run-netns\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-host\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-iptables-alerter-script\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-cnibin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-host\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.662094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-conf\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrtt\" (UniqueName: \"kubernetes.io/projected/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-kube-api-access-kgrtt\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a5a8088-1a8a-4a62-a249-b4529b060c21-registration-dir\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-daemon-config\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-modprobe-d\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-sys\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4vx\" (UniqueName: \"kubernetes.io/projected/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-kube-api-access-sj4vx\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b3160f1-4933-46df-adff-207d0becf29a-host\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-kubelet\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-netns\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysctl-conf\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-script-lib\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660141    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-config\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-tmp\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-system-cni-dir\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-hostroot\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-kubelet-config\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-konnectivity-ca\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ctlr\" (UniqueName: \"kubernetes.io/projected/706a3149-c72c-4f7d-b142-741940059d70-kube-api-access-7ctlr\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysconfig\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-run\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8879b2c-2e02-422e-aea0-3c32776bb894-tmp-dir\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-var-lib-kubelet\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-var-lib-kubelet\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660590    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8705b71-b07b-41bc-8b35-62d8771d19fb-multus-daemon-config\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-systemd-units\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-hostroot\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-kubelet-config\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-run-netns\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.659979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8705b71-b07b-41bc-8b35-62d8771d19fb-cnibin\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.663888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b3160f1-4933-46df-adff-207d0becf29a-host\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.660983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-kubelet\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-run-openvswitch\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661352    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-konnectivity-ca\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-etc-sysconfig\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706a3149-c72c-4f7d-b142-741940059d70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6852d9c7-763e-4350-843e-642056433451-run\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.661649    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.661705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/706a3149-c72c-4f7d-b142-741940059d70-ovnkube-config\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.661724    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:49.161705897 +0000 UTC m=+2.994141018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.662834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/706a3149-c72c-4f7d-b142-741940059d70-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.662923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3-agent-certs\") pod \"konnectivity-agent-6fmz4\" (UID: \"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3\") " pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.664846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.663486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-tmp\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.665596 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.665551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6852d9c7-763e-4350-843e-642056433451-etc-tuned\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.669379 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.669359    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:48.669492 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.669388    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:48.669492 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.669402    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:48.669492 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:48.669477    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:49.169459697 +0000 UTC m=+3.001894816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:48.670807 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.670785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf2t\" (UniqueName: \"kubernetes.io/projected/b8879b2c-2e02-422e-aea0-3c32776bb894-kube-api-access-mbf2t\") pod \"node-resolver-c5kb6\" (UID: \"b8879b2c-2e02-422e-aea0-3c32776bb894\") " pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.673093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.673008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ctlr\" (UniqueName: \"kubernetes.io/projected/706a3149-c72c-4f7d-b142-741940059d70-kube-api-access-7ctlr\") pod \"ovnkube-node-kwxvx\" (UID: \"706a3149-c72c-4f7d-b142-741940059d70\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.673215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.673197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rcb\" (UniqueName: \"kubernetes.io/projected/5b3160f1-4933-46df-adff-207d0becf29a-kube-api-access-w5rcb\") pod \"node-ca-wx27l\" (UID: \"5b3160f1-4933-46df-adff-207d0becf29a\") " pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.673630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.673607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rjd\" (UniqueName: \"kubernetes.io/projected/7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2-kube-api-access-42rjd\") pod \"multus-additional-cni-plugins-qh66g\" (UID: \"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2\") " pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:48.677680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.677631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrxc\" (UniqueName: \"kubernetes.io/projected/b8705b71-b07b-41bc-8b35-62d8771d19fb-kube-api-access-nhrxc\") pod \"multus-kkrqm\" (UID: \"b8705b71-b07b-41bc-8b35-62d8771d19fb\") " pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.678149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.678123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjgts\" (UniqueName: \"kubernetes.io/projected/1a5a8088-1a8a-4a62-a249-b4529b060c21-kube-api-access-vjgts\") pod \"aws-ebs-csi-driver-node-l28qb\" (UID: \"1a5a8088-1a8a-4a62-a249-b4529b060c21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.679805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.679779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4vx\" (UniqueName: \"kubernetes.io/projected/6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f-kube-api-access-sj4vx\") pod \"iptables-alerter-g2cz9\" (UID: \"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f\") " pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.680159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.680135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrtt\" (UniqueName: \"kubernetes.io/projected/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-kube-api-access-kgrtt\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:48.680908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.680888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fkx6\" (UniqueName: \"kubernetes.io/projected/6852d9c7-763e-4350-843e-642056433451-kube-api-access-8fkx6\") pod \"tuned-dk9r8\" (UID: \"6852d9c7-763e-4350-843e-642056433451\") " pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.798386 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.798310    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:48.846363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.846332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2cz9"
Sep 11 13:19:48.850995 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.850944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" event={"ID":"7dd1428d7a8ed86935288a6878be4d6d","Type":"ContainerStarted","Data":"8df731edebefbcc4d10d88804644b0bd207754b7c3b4e4aafeefc22593ddb590"}
Sep 11 13:19:48.852492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.852468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"d41796751870c4f41ab3eee2b4a394d8","Type":"ContainerStarted","Data":"d589e850f713575580d3733d19a7cbfdada03a15526dfa76528f9a2c958072a2"}
Sep 11 13:19:48.861327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.861304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb"
Sep 11 13:19:48.872026 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.872005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5kb6"
Sep 11 13:19:48.878649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.878625    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wx27l"
Sep 11 13:19:48.887647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.887617    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kkrqm"
Sep 11 13:19:48.896275 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.896235    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:19:48.903756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.903738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:19:48.911562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.911542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dk9r8"
Sep 11 13:19:48.917480 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:48.917459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qh66g"
Sep 11 13:19:49.164548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.164458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:49.164548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.164516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:49.164766 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.164633    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:49.164766 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.164658    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:49.164766 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.164707    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:50.164693266 +0000 UTC m=+3.997128385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:49.164766 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.164723    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:50.164715341 +0000 UTC m=+3.997150459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:49.265159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.265117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:49.265323 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.265295    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:49.265323 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.265319    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:49.265431 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.265331    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:49.265431 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.265422    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:50.265381542 +0000 UTC m=+4.097816682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:49.628465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.628375    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 13:14:49 +0000 UTC" deadline="2028-03-17 05:06:24.435483061 +0000 UTC"
Sep 11 13:19:49.628465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.628406    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13263h46m34.807081098s"
Sep 11 13:19:49.833182 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.833138    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3160f1_4933_46df_adff_207d0becf29a.slice/crio-9c2a1a83677d8559d076e7fe1e946802cc06539c301f9b56b822ce53331f1ef9 WatchSource:0}: Error finding container 9c2a1a83677d8559d076e7fe1e946802cc06539c301f9b56b822ce53331f1ef9: Status 404 returned error can't find the container with id 9c2a1a83677d8559d076e7fe1e946802cc06539c301f9b56b822ce53331f1ef9
Sep 11 13:19:49.834349 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.834325    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1439a13_ea3d_4fd4_80ac_e1d6b933c5c3.slice/crio-92a08a27692f6a97372be8b942879e0ddc52c71d1b5e0923d010d362d7e26dc2 WatchSource:0}: Error finding container 92a08a27692f6a97372be8b942879e0ddc52c71d1b5e0923d010d362d7e26dc2: Status 404 returned error can't find the container with id 92a08a27692f6a97372be8b942879e0ddc52c71d1b5e0923d010d362d7e26dc2
Sep 11 13:19:49.835946 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.835900    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8705b71_b07b_41bc_8b35_62d8771d19fb.slice/crio-da8f0493954759c16b1690181f3069fe5cab3c763bcb472a988c5459b99d3ece WatchSource:0}: Error finding container da8f0493954759c16b1690181f3069fe5cab3c763bcb472a988c5459b99d3ece: Status 404 returned error can't find the container with id da8f0493954759c16b1690181f3069fe5cab3c763bcb472a988c5459b99d3ece
Sep 11 13:19:49.837655 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.837363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7561fd_6deb_43c5_b0d8_bb5ffcf3dd3f.slice/crio-47ce2ff2cef442b4452d4f5551d28aaf762d387de2a9647d5dfb24f0624b8c66 WatchSource:0}: Error finding container 47ce2ff2cef442b4452d4f5551d28aaf762d387de2a9647d5dfb24f0624b8c66: Status 404 returned error can't find the container with id 47ce2ff2cef442b4452d4f5551d28aaf762d387de2a9647d5dfb24f0624b8c66
Sep 11 13:19:49.842072 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.842047    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8879b2c_2e02_422e_aea0_3c32776bb894.slice/crio-1e157f6a1b4e2f6b0a0d5bd9e5b2d9f0f2348cfa75cc2ab020c90c1140bf343a WatchSource:0}: Error finding container 1e157f6a1b4e2f6b0a0d5bd9e5b2d9f0f2348cfa75cc2ab020c90c1140bf343a: Status 404 returned error can't find the container with id 1e157f6a1b4e2f6b0a0d5bd9e5b2d9f0f2348cfa75cc2ab020c90c1140bf343a
Sep 11 13:19:49.843767 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.843735    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706a3149_c72c_4f7d_b142_741940059d70.slice/crio-301543afaa45660ec73b3a9601a9f3612110bba7b61e557de0cbd80009bb5cc1 WatchSource:0}: Error finding container 301543afaa45660ec73b3a9601a9f3612110bba7b61e557de0cbd80009bb5cc1: Status 404 returned error can't find the container with id 301543afaa45660ec73b3a9601a9f3612110bba7b61e557de0cbd80009bb5cc1
Sep 11 13:19:49.845079 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.844919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5a8088_1a8a_4a62_a249_b4529b060c21.slice/crio-bde1ba1e9bc6686a90c49545a35a08f5dbcd5dbcbbad2487b6330d0235b7728a WatchSource:0}: Error finding container bde1ba1e9bc6686a90c49545a35a08f5dbcd5dbcbbad2487b6330d0235b7728a: Status 404 returned error can't find the container with id bde1ba1e9bc6686a90c49545a35a08f5dbcd5dbcbbad2487b6330d0235b7728a
Sep 11 13:19:49.846335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.845768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:49.846335 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.846112    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:49.846335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.845825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:49.846335 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:49.846264    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:49.848077 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.847472    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6852d9c7_763e_4350_843e_642056433451.slice/crio-7d3b11774215950b651cc06dbb81d19872985bb45514a7437359215678f7bcd9 WatchSource:0}: Error finding container 7d3b11774215950b651cc06dbb81d19872985bb45514a7437359215678f7bcd9: Status 404 returned error can't find the container with id 7d3b11774215950b651cc06dbb81d19872985bb45514a7437359215678f7bcd9
Sep 11 13:19:49.848077 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:19:49.847718    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6f2e3a_fb7b_4a50_98ac_f42e3f3e31b2.slice/crio-7cff7efbd97fcd292e9b6d4cd60881d1d9cf11d5979e0af4ca88a729f0b00133 WatchSource:0}: Error finding container 7cff7efbd97fcd292e9b6d4cd60881d1d9cf11d5979e0af4ca88a729f0b00133: Status 404 returned error can't find the container with id 7cff7efbd97fcd292e9b6d4cd60881d1d9cf11d5979e0af4ca88a729f0b00133
Sep 11 13:19:49.856525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.856410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5kb6" event={"ID":"b8879b2c-2e02-422e-aea0-3c32776bb894","Type":"ContainerStarted","Data":"1e157f6a1b4e2f6b0a0d5bd9e5b2d9f0f2348cfa75cc2ab020c90c1140bf343a"}
Sep 11 13:19:49.858219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.858191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fmz4" event={"ID":"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3","Type":"ContainerStarted","Data":"92a08a27692f6a97372be8b942879e0ddc52c71d1b5e0923d010d362d7e26dc2"}
Sep 11 13:19:49.860503 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.860442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kkrqm" event={"ID":"b8705b71-b07b-41bc-8b35-62d8771d19fb","Type":"ContainerStarted","Data":"da8f0493954759c16b1690181f3069fe5cab3c763bcb472a988c5459b99d3ece"}
Sep 11 13:19:49.862007 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.861982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx27l" event={"ID":"5b3160f1-4933-46df-adff-207d0becf29a","Type":"ContainerStarted","Data":"9c2a1a83677d8559d076e7fe1e946802cc06539c301f9b56b822ce53331f1ef9"}
Sep 11 13:19:49.863455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.863428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerStarted","Data":"7cff7efbd97fcd292e9b6d4cd60881d1d9cf11d5979e0af4ca88a729f0b00133"}
Sep 11 13:19:49.864791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.864768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dk9r8" event={"ID":"6852d9c7-763e-4350-843e-642056433451","Type":"ContainerStarted","Data":"7d3b11774215950b651cc06dbb81d19872985bb45514a7437359215678f7bcd9"}
Sep 11 13:19:49.866031 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.865990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb" event={"ID":"1a5a8088-1a8a-4a62-a249-b4529b060c21","Type":"ContainerStarted","Data":"bde1ba1e9bc6686a90c49545a35a08f5dbcd5dbcbbad2487b6330d0235b7728a"}
Sep 11 13:19:49.867186 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.867167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"301543afaa45660ec73b3a9601a9f3612110bba7b61e557de0cbd80009bb5cc1"}
Sep 11 13:19:49.868763 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:49.868745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2cz9" event={"ID":"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f","Type":"ContainerStarted","Data":"47ce2ff2cef442b4452d4f5551d28aaf762d387de2a9647d5dfb24f0624b8c66"}
Sep 11 13:19:50.172380 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.172353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:50.172485 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.172399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:50.172583 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.172523    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:50.172583 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.172557    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:50.172679 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.172591    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.172574273 +0000 UTC m=+6.005009394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:50.172679 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.172612    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.17259736 +0000 UTC m=+6.005032501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:50.273419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.273386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:50.273602 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.273586    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:50.273652 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.273608    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:50.273652 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.273618    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:50.273760 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.273678    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.273660766 +0000 UTC m=+6.106095900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:50.629368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.629252    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 13:14:49 +0000 UTC" deadline="2028-02-16 21:41:16.164534449 +0000 UTC"
Sep 11 13:19:50.629368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.629318    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12560h21m25.535221147s"
Sep 11 13:19:50.858450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.858417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:50.858640 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:50.858563    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:50.880239 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.880160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" event={"ID":"7dd1428d7a8ed86935288a6878be4d6d","Type":"ContainerStarted","Data":"d9e28e2d63a2cd7a875a4346b1ebeeb22ec333fef22605f263db9e2522a08497"}
Sep 11 13:19:50.893025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.892576    2582 generic.go:356] "Generic (PLEG): container finished" podID="d41796751870c4f41ab3eee2b4a394d8" containerID="b66fe656edb5b1e3d0d61a8403d8b67b4ac97ac8e0fde4257f0051d01b9b038e" exitCode=0
Sep 11 13:19:50.893025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.892621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"d41796751870c4f41ab3eee2b4a394d8","Type":"ContainerDied","Data":"b66fe656edb5b1e3d0d61a8403d8b67b4ac97ac8e0fde4257f0051d01b9b038e"}
Sep 11 13:19:50.938794 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:50.938731    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-92.ec2.internal" podStartSLOduration=2.938709609 podStartE2EDuration="2.938709609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:50.908744573 +0000 UTC m=+4.741179718" watchObservedRunningTime="2026-09-11 13:19:50.938709609 +0000 UTC m=+4.771144761"
Sep 11 13:19:51.846245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:51.846163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:51.846996 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:51.846320    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:51.846996 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:51.846874    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:51.847119 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:51.846992    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:51.923930 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:51.923889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" event={"ID":"d41796751870c4f41ab3eee2b4a394d8","Type":"ContainerStarted","Data":"549cd822fb5b5c8243b60a93d3f5f7e239662d5baa9a6e59a775136f45dd060f"}
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:52.192326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:52.192395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.192563    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.192565    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.192632    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:56.192613173 +0000 UTC m=+10.025048295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:52.192759 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.192653    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:56.192643356 +0000 UTC m=+10.025078483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:52.293631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:52.293257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:52.293631 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.293459    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:52.293631 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.293481    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:52.293631 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.293493    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:52.293631 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.293570    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:56.293536486 +0000 UTC m=+10.125971611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:52.845807 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:52.845744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:52.845988 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:52.845888    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:53.847364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:53.846848    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:53.847364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:53.846899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:53.847364 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:53.846993    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:53.847364 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:53.847126    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:54.851422 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:54.851061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:54.851422 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:54.851219    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:55.846698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:55.846662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:55.846698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:55.846690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:55.846933 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:55.846828    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:55.846988 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:55.846964    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:56.227431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:56.227353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:56.227431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:56.227416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:56.227932 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.227585    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:56.227932 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.227650    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:04.227630049 +0000 UTC m=+18.060065172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:56.228071 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.228051    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:56.228134 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.228112    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:04.228095333 +0000 UTC m=+18.060530451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:56.328486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:56.328449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:56.328654 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.328629    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:56.328654 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.328654    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:56.328770 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.328667    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:56.328770 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.328733    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:04.328714748 +0000 UTC m=+18.161149882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:56.846765 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:56.846732    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:56.846946 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:56.846847    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:57.845997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:57.845965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:57.846544 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:57.846100    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:57.846544 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:57.845975    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:57.846544 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:57.846435    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:19:58.846208 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:58.846174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:19:58.846677 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:58.846307    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:19:59.846413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:59.846378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:19:59.846837 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:19:59.846385    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:19:59.846837 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:59.846521    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:19:59.846837 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:19:59.846597    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:00.846367 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:00.846287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:00.846532 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:00.846409    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:01.846382 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:01.846347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:01.846615 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:01.846347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:01.846615 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:01.846494    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:01.846615 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:01.846574    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:02.846216 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:02.846181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:02.846392 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:02.846330    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:03.846346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:03.846313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:03.846796 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:03.846411    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:03.846796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:03.846480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:03.846796 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:03.846607    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:04.283862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:04.283775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:04.283862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:04.283836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:04.284087 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.283944    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:04.284087 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.283966    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:04.284087 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.284024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:20.284001377 +0000 UTC m=+34.116436504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:04.284087 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.284045    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:20.284035098 +0000 UTC m=+34.116470220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:04.384930 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:04.384890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:04.385096 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.385035    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:20:04.385096 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.385055    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:20:04.385096 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.385066    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:04.385301 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.385121    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:20.385103942 +0000 UTC m=+34.217539058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:04.846406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:04.846371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:04.846882 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:04.846488    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:05.846563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:05.846529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:05.847012 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:05.846533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:05.847012 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:05.846662    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:05.847012 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:05.846745    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:06.846720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:06.846686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:06.847125 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:06.846838    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:07.846393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:07.846365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:07.846514 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:07.846366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:07.846514 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:07.846462    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:07.846593 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:07.846554    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:08.846472 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.846250    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:08.847156 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:08.846540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:08.960747 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.960709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wx27l" event={"ID":"5b3160f1-4933-46df-adff-207d0becf29a","Type":"ContainerStarted","Data":"f59982c5ff9b576e5f48b9f89720cf250ad621275bb450e51b2dc3ba4858bb34"}
Sep 11 13:20:08.962719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.962688    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="d31355b9c13009c95c53580ca84cec1e569012e1bafea8b42dc8a0d60d2023a1" exitCode=0
Sep 11 13:20:08.962862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.962767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"d31355b9c13009c95c53580ca84cec1e569012e1bafea8b42dc8a0d60d2023a1"}
Sep 11 13:20:08.964538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.964492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dk9r8" event={"ID":"6852d9c7-763e-4350-843e-642056433451","Type":"ContainerStarted","Data":"e5c9f05a7bd2e4ee7c44ef2f3fa5e1b52ec3af7f47602ed0af04eca9a33a648b"}
Sep 11 13:20:08.966188 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.966161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb" event={"ID":"1a5a8088-1a8a-4a62-a249-b4529b060c21","Type":"ContainerStarted","Data":"89388752d9ced3b4bf2a925139fdf90fba2f95ded573dc5414534b2cd50db840"}
Sep 11 13:20:08.969655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"729bbb99ac461e77b2b03d757954dcd82a2242c10a19e9b6746a1b3e16b2ca0f"}
Sep 11 13:20:08.969745 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"d923e90056e986024fdb45c1fcf81b914c951a65a740131e097beb2d355d7e6f"}
Sep 11 13:20:08.969792 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"fda051970d6049333f1c21816b997565bba31334ca90e1b3000cbd724b77fdeb"}
Sep 11 13:20:08.969842 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"9cad05ffaca681826ed22bd3b5dff81a4a33f6b12a4c94ef90622d146c15b778"}
Sep 11 13:20:08.969896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"9e16bc33a2aa33129217b3bb16fadedf2fad19c0a4abc040bdfa140ec7e6c15b"}
Sep 11 13:20:08.969950 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.969937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"958bbe4e73d7fa54fb1ae5adfc6498ea34e630df5007e1cb60bd9581b22d3bf1"}
Sep 11 13:20:08.971616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.971594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5kb6" event={"ID":"b8879b2c-2e02-422e-aea0-3c32776bb894","Type":"ContainerStarted","Data":"ed63fdec75bb9ac223aea353cf5dee397cf6d460851b3467ea9839b02070fa64"}
Sep 11 13:20:08.973104 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.973084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fmz4" event={"ID":"c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3","Type":"ContainerStarted","Data":"94b28feed241a3f55bfc0dc233336ddafc77bef7eb0f4cd52acf6a5afb030894"}
Sep 11 13:20:08.974648 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.974627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kkrqm" event={"ID":"b8705b71-b07b-41bc-8b35-62d8771d19fb","Type":"ContainerStarted","Data":"f357b615f41ed1830570ec61b36403af42bd5e831541470c5eaad6c865441392"}
Sep 11 13:20:08.977791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.977756    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wx27l" podStartSLOduration=3.9473525929999997 podStartE2EDuration="21.977743847s" totalImagesPullingTime="18.030391254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:08.977388671 +0000 UTC m=+22.809823811" watchObservedRunningTime="2026-09-11 13:20:08.977743847 +0000 UTC m=+22.810178985"
Sep 11 13:20:08.977874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:08.977828    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-92.ec2.internal" podStartSLOduration=20.97782158 podStartE2EDuration="20.97782158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:51.9523997 +0000 UTC m=+5.784834845" watchObservedRunningTime="2026-09-11 13:20:08.97782158 +0000 UTC m=+22.810256722"
Sep 11 13:20:09.007597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.007561    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c5kb6" podStartSLOduration=3.971564285 podStartE2EDuration="22.00754859s" totalImagesPullingTime="18.035984305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:09.007236327 +0000 UTC m=+22.839671466" watchObservedRunningTime="2026-09-11 13:20:09.00754859 +0000 UTC m=+22.839983730"
Sep 11 13:20:09.080477 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.080431    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dk9r8" podStartSLOduration=4.047653938 podStartE2EDuration="22.080418501s" totalImagesPullingTime="18.032764563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:09.041637878 +0000 UTC m=+22.874073017" watchObservedRunningTime="2026-09-11 13:20:09.080418501 +0000 UTC m=+22.912853639"
Sep 11 13:20:09.099399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.099330    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kkrqm" podStartSLOduration=3.785305517 podStartE2EDuration="22.099317007s" totalImagesPullingTime="18.31401149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:09.098926133 +0000 UTC m=+22.931361272" watchObservedRunningTime="2026-09-11 13:20:09.099317007 +0000 UTC m=+22.931752145"
Sep 11 13:20:09.124245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.124196    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6fmz4" podStartSLOduration=11.492834684 podStartE2EDuration="22.124182317s" totalImagesPullingTime="10.631347633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:09.124024521 +0000 UTC m=+22.956459659" watchObservedRunningTime="2026-09-11 13:20:09.124182317 +0000 UTC m=+22.956617457"
Sep 11 13:20:09.278699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.278666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:09.359688 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.359659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:09.414359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.414329    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 13:20:09.601892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.601736    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T13:20:09.414343613Z","UUID":"b65daff6-ab91-4ca6-870f-b402bc580b47","Handler":null,"Name":"","Endpoint":""}
Sep 11 13:20:09.603247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.603225    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 13:20:09.603422 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.603260    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 13:20:09.845889 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.845759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:09.845889 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.845803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:09.846099 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:09.845892    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:09.846099 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:09.846000    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:09.979792 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.979757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb" event={"ID":"1a5a8088-1a8a-4a62-a249-b4529b060c21","Type":"ContainerStarted","Data":"57362a25b9ba0ba1b23d00d3caad27b00d762011ccdbf9e55d561aac35bf076a"}
Sep 11 13:20:09.984542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:09.984493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2cz9" event={"ID":"6d7561fd-6deb-43c5-b0d8-bb5ffcf3dd3f","Type":"ContainerStarted","Data":"683c8b39fb8532ab9db3673f970dffe1555cd4fb26a4f79e68d2b77a99555d49"}
Sep 11 13:20:10.122706 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:10.122613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:10.196951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:10.196916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:10.846926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:10.846665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:10.847075 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:10.846981    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:10.989155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:10.989115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb" event={"ID":"1a5a8088-1a8a-4a62-a249-b4529b060c21","Type":"ContainerStarted","Data":"5376de6ba2eaadf7a3a510bb3f4f76b6e542ffae75455ddd80856659fa2e987b"}
Sep 11 13:20:10.992941 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:10.992916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"0ede5a9b601f7724f21cfd50d0516c2b65bcb190eb5daad3fc4004ab387bd801"}
Sep 11 13:20:11.017429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:11.017376    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g2cz9" podStartSLOduration=5.977083959 podStartE2EDuration="24.017354349s" totalImagesPullingTime="18.04027039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:10.00053497 +0000 UTC m=+23.832970134" watchObservedRunningTime="2026-09-11 13:20:11.017354349 +0000 UTC m=+24.849789490"
Sep 11 13:20:11.017843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:11.017809    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l28qb" podStartSLOduration=4.020943099 podStartE2EDuration="24.017795064s" totalImagesPullingTime="19.996851965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:11.017355714 +0000 UTC m=+24.849790853" watchObservedRunningTime="2026-09-11 13:20:11.017795064 +0000 UTC m=+24.850230203"
Sep 11 13:20:11.846667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:11.846635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:11.846854 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:11.846748    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:11.846854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:11.846816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:11.846978 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:11.846928    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:12.846202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:12.846170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:12.846604 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:12.846295    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:13.660937 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:13.660710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:20:13.661256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:13.661237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:20:13.846694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:13.846664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:13.847036 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:13.846702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:13.847036 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:13.846761    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:13.847036 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:13.846863    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:14.000835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.000769    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="5bb9e75268637cc9d15dae59c116edefa48c72439a222ac16d50ba2a4934522e" exitCode=0
Sep 11 13:20:14.000967 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.000851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"5bb9e75268637cc9d15dae59c116edefa48c72439a222ac16d50ba2a4934522e"}
Sep 11 13:20:14.005183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" event={"ID":"706a3149-c72c-4f7d-b142-741940059d70","Type":"ContainerStarted","Data":"f81751deac7e885341a61e0c4f60cc569e300ed50e94f464691cebba3dabbf60"}
Sep 11 13:20:14.005363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:20:14.005554 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:14.005654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:14.005740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:14.005824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.005789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6fmz4"
Sep 11 13:20:14.020461 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.020439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:14.020663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.020649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:14.119136 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.119096    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx" podStartSLOduration=9.065743783 podStartE2EDuration="27.119083202s" totalImagesPullingTime="18.053339419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:14.117182767 +0000 UTC m=+27.949617906" watchObservedRunningTime="2026-09-11 13:20:14.119083202 +0000 UTC m=+27.951518341"
Sep 11 13:20:14.201220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.201196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:14.847527 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:14.846278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:14.847527 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:14.846382    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:15.010114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.010088    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="e175eedfd7b3ba91819faa28853c19d4b29c664b8b10a65bb632d9f392add4c7" exitCode=0
Sep 11 13:20:15.010221 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.010154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"e175eedfd7b3ba91819faa28853c19d4b29c664b8b10a65bb632d9f392add4c7"}
Sep 11 13:20:15.228642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.228610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4z5l"]
Sep 11 13:20:15.228778 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.228758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:15.228884 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:15.228863    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:15.234346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.234318    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vjjx9"]
Sep 11 13:20:15.234464 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.234429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:15.234594 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:15.234570    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:15.234997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.234978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csggs"]
Sep 11 13:20:15.235067 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:15.235054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:15.235132 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:15.235116    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:16.015177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:16.014929    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="f86f048c7b7dca9a85031d8fd447c6a01004b5ef9c85a0e6b377832f84531dcc" exitCode=0
Sep 11 13:20:16.015177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:16.015005    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"f86f048c7b7dca9a85031d8fd447c6a01004b5ef9c85a0e6b377832f84531dcc"}
Sep 11 13:20:16.847387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:16.847360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:16.847539 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:16.847443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:16.847539 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:16.847522    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:16.847855 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:16.847710    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:16.847855 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:16.847717    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:16.847855 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:16.847821    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:17.835294 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:17.835205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:18.846375 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:18.846197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:18.846375 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:18.846208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:18.846375 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:18.846324    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:18.847001 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:18.846381    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:18.847001 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:18.846414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:18.847001 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:18.846533    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:20.294228 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.294201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:20.294681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.294260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:20.294681 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.294346    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:20.294681 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.294402    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret podName:e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:52.294387067 +0000 UTC m=+66.126822184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret") pod "global-pull-secret-syncer-csggs" (UID: "e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:20.294681 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.294402    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:20.294681 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.294448    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:52.294434274 +0000 UTC m=+66.126869404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:20.394664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.394645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:20.394762 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.394749    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:20:20.394799 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.394767    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:20:20.394799 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.394776    2582 projected.go:196] Error preparing data for projected volume kube-api-access-lnrs2 for pod openshift-network-diagnostics/network-check-target-f4z5l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:20.394869 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.394816    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2 podName:3f8ad8cb-d54c-4980-8ffb-0de42c023bf7 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:52.394804142 +0000 UTC m=+66.227239273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lnrs2" (UniqueName: "kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2") pod "network-check-target-f4z5l" (UID: "3f8ad8cb-d54c-4980-8ffb-0de42c023bf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:20.486159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.486133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:20.598988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.598961    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:20.846538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.846513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:20.846634 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.846559    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:20.846634 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.846515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:20.846741 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.846637    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vjjx9" podUID="998f2146-c7a8-4ee3-9a56-a0a3f1ae8356"
Sep 11 13:20:20.846741 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.846729    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-csggs" podUID="e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5"
Sep 11 13:20:20.846819 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:20.846770    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4z5l" podUID="3f8ad8cb-d54c-4980-8ffb-0de42c023bf7"
Sep 11 13:20:20.958573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.958554    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-92.ec2.internal" event="NodeReady"
Sep 11 13:20:20.958679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:20.958646    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 13:20:21.009364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.009342    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bbmkd"]
Sep 11 13:20:21.028831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.028784    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cshr4"]
Sep 11 13:20:21.028941 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.028857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.033704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.033685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 13:20:21.034123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.034077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-flkcx\""
Sep 11 13:20:21.035927 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.035900    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="c1c43f47449f0be7cf4c30a50353ca896ab99f94b6622aea1c1f7375367ce8fe" exitCode=0
Sep 11 13:20:21.037682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.037661    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 13:20:21.047210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.047159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"c1c43f47449f0be7cf4c30a50353ca896ab99f94b6622aea1c1f7375367ce8fe"}
Sep 11 13:20:21.047210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.047199    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cshr4"]
Sep 11 13:20:21.047328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.047219    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbmkd"]
Sep 11 13:20:21.047328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.047254    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.050812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.050795    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rsfmf\""
Sep 11 13:20:21.050975 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.050954    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 13:20:21.051044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.051019    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 13:20:21.051097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.051049    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 13:20:21.099184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.099061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ba1b359-cd4e-445e-8c41-8eb1f504e814-config-volume\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.099184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.099157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba1b359-cd4e-445e-8c41-8eb1f504e814-tmp-dir\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.099381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.099200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx8t\" (UniqueName: \"kubernetes.io/projected/6ba1b359-cd4e-445e-8c41-8eb1f504e814-kube-api-access-jrx8t\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.099381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.099279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200162 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6nc\" (UniqueName: \"kubernetes.io/projected/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-kube-api-access-wf6nc\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.200260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ba1b359-cd4e-445e-8c41-8eb1f504e814-config-volume\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba1b359-cd4e-445e-8c41-8eb1f504e814-tmp-dir\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx8t\" (UniqueName: \"kubernetes.io/projected/6ba1b359-cd4e-445e-8c41-8eb1f504e814-kube-api-access-jrx8t\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-cert\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.200346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200495 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:21.200469    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:21.200622 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:21.200553    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:21.700532226 +0000 UTC m=+35.532967343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:21.200622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba1b359-cd4e-445e-8c41-8eb1f504e814-tmp-dir\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.200725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.200696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ba1b359-cd4e-445e-8c41-8eb1f504e814-config-volume\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.202893 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.202870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.214637 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.214438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx8t\" (UniqueName: \"kubernetes.io/projected/6ba1b359-cd4e-445e-8c41-8eb1f504e814-kube-api-access-jrx8t\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.300738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.300681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6nc\" (UniqueName: \"kubernetes.io/projected/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-kube-api-access-wf6nc\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.301077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.300775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-cert\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.301077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.300928    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:21.303090 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.303069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-cert\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.313140 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.313120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6nc\" (UniqueName: \"kubernetes.io/projected/cac16b1d-9d3d-4856-a189-e9eafad2e4b6-kube-api-access-wf6nc\") pod \"ingress-canary-cshr4\" (UID: \"cac16b1d-9d3d-4856-a189-e9eafad2e4b6\") " pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.355134 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.355112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cshr4"
Sep 11 13:20:21.663389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.663367    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cshr4"]
Sep 11 13:20:21.665908 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:20:21.665876    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac16b1d_9d3d_4856_a189_e9eafad2e4b6.slice/crio-27e89b97307775a1f8716d75d97c3f1f59186e37e393ff1f3edd445ed51927ac WatchSource:0}: Error finding container 27e89b97307775a1f8716d75d97c3f1f59186e37e393ff1f3edd445ed51927ac: Status 404 returned error can't find the container with id 27e89b97307775a1f8716d75d97c3f1f59186e37e393ff1f3edd445ed51927ac
Sep 11 13:20:21.704675 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:21.704646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:21.704780 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:21.704756    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:21.704840 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:21.704818    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:22.704798609 +0000 UTC m=+36.537233746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:22.039424 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.039337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cshr4" event={"ID":"cac16b1d-9d3d-4856-a189-e9eafad2e4b6","Type":"ContainerStarted","Data":"27e89b97307775a1f8716d75d97c3f1f59186e37e393ff1f3edd445ed51927ac"}
Sep 11 13:20:22.042249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.042218    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2" containerID="5da1448eb37414e0b4cc1c40225f8cca59b11dfa0565b7244f458349130afdce" exitCode=0
Sep 11 13:20:22.042359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.042258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerDied","Data":"5da1448eb37414e0b4cc1c40225f8cca59b11dfa0565b7244f458349130afdce"}
Sep 11 13:20:22.714726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.714691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:22.715491 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:22.714867    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:22.715491 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:22.714942    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:24.714920268 +0000 UTC m=+38.547355399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:22.846120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.846039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:22.846297 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.846039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:22.846297 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.846183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:22.853753 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.853561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 13:20:22.853753 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.853568    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 13:20:22.854373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.854356    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4k5\""
Sep 11 13:20:22.854483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.854376    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 13:20:22.854483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.854375    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 13:20:22.854483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.854427    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2xgs9\""
Sep 11 13:20:22.862258 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:22.862234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:23.049310 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:23.049230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qh66g" event={"ID":"7b6f2e3a-fb7b-4a50-98ac-f42e3f3e31b2","Type":"ContainerStarted","Data":"2a6255e17c03ba3a694ba9d01c47ea42f9949f892e58999abf7a6ab4a0e48cb7"}
Sep 11 13:20:23.091136 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:23.091061    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qh66g" podStartSLOduration=8.33924843 podStartE2EDuration="36.091045385s" totalImagesPullingTime="27.751796955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:23.091041598 +0000 UTC m=+36.923476740" watchObservedRunningTime="2026-09-11 13:20:23.091045385 +0000 UTC m=+36.923480525"
Sep 11 13:20:23.249241 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:23.249194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:23.418821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:23.418737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:23.616666 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:23.616632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:24.728870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:24.728687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:24.729256 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:24.728827    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:24.729256 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:24.728938    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:28.728924299 +0000 UTC m=+42.561359420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:25.055053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:25.054983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cshr4" event={"ID":"cac16b1d-9d3d-4856-a189-e9eafad2e4b6","Type":"ContainerStarted","Data":"91be4b75e8f14e262491b52f010a242aca92c96fda457f7e4671f6135477067f"}
Sep 11 13:20:26.468040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:26.468008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:26.547901 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:26.547874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:28.408453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:28.408417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:28.530189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:28.530160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:28.755262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:28.755194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:28.755388 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:28.755361    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:28.755429 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:28.755417    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:36.755401939 +0000 UTC m=+50.587837056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:36.803808 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:36.803772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:36.804234 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:36.803878    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:36.804234 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:36.803936    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:52.803924175 +0000 UTC m=+66.636359304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:43.994153 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:43.994123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:45.644877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:45.644843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:46.025489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:46.025466    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxvx"
Sep 11 13:20:46.073037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:46.072990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cshr4" podStartSLOduration=23.604567753 podStartE2EDuration="26.072975052s" totalImagesPullingTime="2.468407299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:25.087827519 +0000 UTC m=+38.920262659" watchObservedRunningTime="2026-09-11 13:20:46.072975052 +0000 UTC m=+59.905410182"
Sep 11 13:20:46.223256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:46.223232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:46.322860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:46.322793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:46.434617 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:46.434596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:20:52.306118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.306076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:52.306534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.306149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:20:52.312911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.312891    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 13:20:52.313018 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.313002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 13:20:52.317286 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:52.317269    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 13:20:52.317352 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:52.317342    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs podName:998f2146-c7a8-4ee3-9a56-a0a3f1ae8356 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:56.317327067 +0000 UTC m=+130.149762202 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs") pod "network-metrics-daemon-vjjx9" (UID: "998f2146-c7a8-4ee3-9a56-a0a3f1ae8356") : secret "metrics-daemon-secret" not found
Sep 11 13:20:52.320415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.320392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5-original-pull-secret\") pod \"global-pull-secret-syncer-csggs\" (UID: \"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5\") " pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:52.407101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.407072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:52.411172 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.411155    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 13:20:52.421510 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.421489    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 13:20:52.431080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.431057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnrs2\" (UniqueName: \"kubernetes.io/projected/3f8ad8cb-d54c-4980-8ffb-0de42c023bf7-kube-api-access-lnrs2\") pod \"network-check-target-f4z5l\" (UID: \"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7\") " pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:52.569386 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.569303    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4k5\""
Sep 11 13:20:52.572755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.572728    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-csggs"
Sep 11 13:20:52.577801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.577788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:52.810384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.810346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:20:52.810585 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:52.810476    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:52.810585 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:20:52.810544    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls podName:6ba1b359-cd4e-445e-8c41-8eb1f504e814 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:24.810530706 +0000 UTC m=+98.642965836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls") pod "dns-default-bbmkd" (UID: "6ba1b359-cd4e-445e-8c41-8eb1f504e814") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:52.857534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.857497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-csggs"]
Sep 11 13:20:52.859117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:52.859089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4z5l"]
Sep 11 13:20:52.859763 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:20:52.859735    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a3c897_9e78_4ee7_9f7b_c32a5adba1e5.slice/crio-098e1f1101dfb4dcecdd49093d588b5fdad321db16983341e3f0734590837e11 WatchSource:0}: Error finding container 098e1f1101dfb4dcecdd49093d588b5fdad321db16983341e3f0734590837e11: Status 404 returned error can't find the container with id 098e1f1101dfb4dcecdd49093d588b5fdad321db16983341e3f0734590837e11
Sep 11 13:20:52.861916 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:20:52.861877    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8ad8cb_d54c_4980_8ffb_0de42c023bf7.slice/crio-14b0a12004c0bf9436f27ae9b0b71e0ab5a77bb8476cb63886f686d19d7e2256 WatchSource:0}: Error finding container 14b0a12004c0bf9436f27ae9b0b71e0ab5a77bb8476cb63886f686d19d7e2256: Status 404 returned error can't find the container with id 14b0a12004c0bf9436f27ae9b0b71e0ab5a77bb8476cb63886f686d19d7e2256
Sep 11 13:20:53.120363 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:53.120281    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4z5l" event={"ID":"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7","Type":"ContainerStarted","Data":"14b0a12004c0bf9436f27ae9b0b71e0ab5a77bb8476cb63886f686d19d7e2256"}
Sep 11 13:20:53.121330 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:53.121307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csggs" event={"ID":"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5","Type":"ContainerStarted","Data":"098e1f1101dfb4dcecdd49093d588b5fdad321db16983341e3f0734590837e11"}
Sep 11 13:20:58.136467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:58.136431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4z5l" event={"ID":"3f8ad8cb-d54c-4980-8ffb-0de42c023bf7","Type":"ContainerStarted","Data":"8d59240eab098381e8ef5bf0a39b8affb5f1f6554de29621acd28d4751c930bd"}
Sep 11 13:20:58.136890 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:58.136550    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:20:58.138079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:58.138059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-csggs" event={"ID":"e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5","Type":"ContainerStarted","Data":"fb1b527650eae16dcc30856dfdd4e007796e4e7fb580b5adf5f76a8db85574ac"}
Sep 11 13:20:58.183619 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:20:58.183576    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f4z5l" podStartSLOduration=66.734863684 podStartE2EDuration="1m11.183560456s" totalImagesPullingTime="4.448696772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:58.161271766 +0000 UTC m=+71.993706920" watchObservedRunningTime="2026-09-11 13:20:58.183560456 +0000 UTC m=+72.015995586"
Sep 11 13:21:12.604296 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.604121    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-csggs" podStartSLOduration=81.140869458 podStartE2EDuration="1m25.604103691s" totalImagesPullingTime="4.463234233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:58.184007177 +0000 UTC m=+72.016442319" watchObservedRunningTime="2026-09-11 13:21:12.604103691 +0000 UTC m=+86.436538829"
Sep 11 13:21:12.604828 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.604741    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"]
Sep 11 13:21:12.607215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.607181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.609684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.609662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 13:21:12.609794 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.609683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nmtmb\""
Sep 11 13:21:12.610946 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.610930    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 13:21:12.627581 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.627549    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"]
Sep 11 13:21:12.699417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.699389    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"]
Sep 11 13:21:12.701449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.701432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.703825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.703804    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 13:21:12.704064 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.704048    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bhxh7\""
Sep 11 13:21:12.704454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.704438    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.704548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.704483    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.704548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.704436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 13:21:12.722743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.722719    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-p45fg"]
Sep 11 13:21:12.725376 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.725358    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cbfcdc64b-9rglm"]
Sep 11 13:21:12.725488 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.725473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.727060 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.727043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"]
Sep 11 13:21:12.727134 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.727113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.736316 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.736297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d81c9284-9707-4425-aada-58fc212ab9a5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.736383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.736338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.785074 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.785056    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.785162 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.785057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.785414 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.785400    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c79rh\""
Sep 11 13:21:12.785902 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.785887    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 13:21:12.790155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.790142    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 13:21:12.799826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.799808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-p45fg"]
Sep 11 13:21:12.805267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.805252    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.806841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.806827    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 13:21:12.807105 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.807088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 13:21:12.807315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.807298    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gmxng\""
Sep 11 13:21:12.837562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-snapshots\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45aae79c-25ad-41db-9623-c5a41c3f3620-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-default-certificate\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-service-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d81c9284-9707-4425-aada-58fc212ab9a5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.837768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnr5j\" (UniqueName: \"kubernetes.io/projected/45aae79c-25ad-41db-9623-c5a41c3f3620-kube-api-access-vnr5j\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fafe594-936f-40ba-9709-a7073fe1c18a-serving-cert\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-tmp\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:12.837932    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-stats-auth\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.837975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.838041 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:12.837992    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.337976943 +0000 UTC m=+87.170412066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:12.838305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.838045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6sw\" (UniqueName: \"kubernetes.io/projected/1fafe594-936f-40ba-9709-a7073fe1c18a-kube-api-access-tn6sw\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.838305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.838072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6c2w\" (UniqueName: \"kubernetes.io/projected/563d51ca-738f-4f55-b006-aa87c7d5c104-kube-api-access-p6c2w\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.838305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.838100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45aae79c-25ad-41db-9623-c5a41c3f3620-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.838305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.838219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d81c9284-9707-4425-aada-58fc212ab9a5-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:12.851098 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.851076    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 13:21:12.851356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.851341    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 13:21:12.851915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.851901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.872373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.872330    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 13:21:12.881925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.881903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cbfcdc64b-9rglm"]
Sep 11 13:21:12.938670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-tmp\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.938766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-stats-auth\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.938766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.938766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6sw\" (UniqueName: \"kubernetes.io/projected/1fafe594-936f-40ba-9709-a7073fe1c18a-kube-api-access-tn6sw\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.938928 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6c2w\" (UniqueName: \"kubernetes.io/projected/563d51ca-738f-4f55-b006-aa87c7d5c104-kube-api-access-p6c2w\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.938928 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45aae79c-25ad-41db-9623-c5a41c3f3620-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.939042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-snapshots\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.939042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.938993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.939042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45aae79c-25ad-41db-9623-c5a41c3f3620-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-default-certificate\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-service-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:12.939107    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:12.939134    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.439114789 +0000 UTC m=+87.271549920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : configmap references non-existent config key: service-ca.crt
Sep 11 13:21:12.939205 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:12.939192    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.439179474 +0000 UTC m=+87.271614591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : secret "router-metrics-certs-default" not found
Sep 11 13:21:12.939559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnr5j\" (UniqueName: \"kubernetes.io/projected/45aae79c-25ad-41db-9623-c5a41c3f3620-kube-api-access-vnr5j\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.939559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fafe594-936f-40ba-9709-a7073fe1c18a-serving-cert\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.939559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-tmp\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.939740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.939716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45aae79c-25ad-41db-9623-c5a41c3f3620-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.940025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.940000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-service-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.940247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.940227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fafe594-936f-40ba-9709-a7073fe1c18a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.940321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.940279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1fafe594-936f-40ba-9709-a7073fe1c18a-snapshots\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.941520 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.941476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45aae79c-25ad-41db-9623-c5a41c3f3620-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.941620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.941567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-default-certificate\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.941665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.941649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-stats-auth\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.941902 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.941881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fafe594-936f-40ba-9709-a7073fe1c18a-serving-cert\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:12.954401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.954375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6c2w\" (UniqueName: \"kubernetes.io/projected/563d51ca-738f-4f55-b006-aa87c7d5c104-kube-api-access-p6c2w\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:12.954627 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.954605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnr5j\" (UniqueName: \"kubernetes.io/projected/45aae79c-25ad-41db-9623-c5a41c3f3620-kube-api-access-vnr5j\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qwfrl\" (UID: \"45aae79c-25ad-41db-9623-c5a41c3f3620\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:12.954715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:12.954702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6sw\" (UniqueName: \"kubernetes.io/projected/1fafe594-936f-40ba-9709-a7073fe1c18a-kube-api-access-tn6sw\") pod \"insights-operator-5844b856db-p45fg\" (UID: \"1fafe594-936f-40ba-9709-a7073fe1c18a\") " pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:13.009892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.009868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"
Sep 11 13:21:13.034348 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.034328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-p45fg"
Sep 11 13:21:13.073428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.073393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.146050 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.145977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:13.284392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.284358    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl"]
Sep 11 13:21:13.289158 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:13.289114    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aae79c_25ad_41db_9623_c5a41c3f3620.slice/crio-8d736666092c499048ed63a54822396760e86f82de1f1caf08c69a3917752d99 WatchSource:0}: Error finding container 8d736666092c499048ed63a54822396760e86f82de1f1caf08c69a3917752d99: Status 404 returned error can't find the container with id 8d736666092c499048ed63a54822396760e86f82de1f1caf08c69a3917752d99
Sep 11 13:21:13.318042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.318013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-p45fg"]
Sep 11 13:21:13.321025 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:13.321001    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fafe594_936f_40ba_9709_a7073fe1c18a.slice/crio-f26bc1ccb7dac407c0ec231adaa3082b61e9ebb9a94ffb559fcd244ceddb2ada WatchSource:0}: Error finding container f26bc1ccb7dac407c0ec231adaa3082b61e9ebb9a94ffb559fcd244ceddb2ada: Status 404 returned error can't find the container with id f26bc1ccb7dac407c0ec231adaa3082b61e9ebb9a94ffb559fcd244ceddb2ada
Sep 11 13:21:13.341140 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.341119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:13.341274 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:13.341256    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:13.341323 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:13.341315    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.341300376 +0000 UTC m=+88.173735497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:13.441874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.441814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:13.441874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:13.441847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:13.442004 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:13.441935    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 13:21:13.442004 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:13.441983    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.441968913 +0000 UTC m=+88.274404034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : secret "router-metrics-certs-default" not found
Sep 11 13:21:13.442004 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:13.441996    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.441990024 +0000 UTC m=+88.274425140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : configmap references non-existent config key: service-ca.crt
Sep 11 13:21:14.178020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.177987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl" event={"ID":"45aae79c-25ad-41db-9623-c5a41c3f3620","Type":"ContainerStarted","Data":"8d736666092c499048ed63a54822396760e86f82de1f1caf08c69a3917752d99"}
Sep 11 13:21:14.179285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.179259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-p45fg" event={"ID":"1fafe594-936f-40ba-9709-a7073fe1c18a","Type":"ContainerStarted","Data":"f26bc1ccb7dac407c0ec231adaa3082b61e9ebb9a94ffb559fcd244ceddb2ada"}
Sep 11 13:21:14.349743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.349699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:14.349975 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:14.349955    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:14.350047 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:14.350030    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.350010668 +0000 UTC m=+90.182445788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:14.450640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.450561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:14.450640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.450607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:14.450845 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:14.450747    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.450724557 +0000 UTC m=+90.283159698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : configmap references non-existent config key: service-ca.crt
Sep 11 13:21:14.450845 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:14.450747    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 13:21:14.450845 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:14.450813    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.450790272 +0000 UTC m=+90.283225406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : secret "router-metrics-certs-default" not found
Sep 11 13:21:14.987646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:14.987602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:15.122984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:15.122950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:16.186992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.186958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl" event={"ID":"45aae79c-25ad-41db-9623-c5a41c3f3620","Type":"ContainerStarted","Data":"6b411513d9529ca45f502d5ee99b98769a06aac0e7c76cbff2f97905a238d940"}
Sep 11 13:21:16.188554 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.188529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-p45fg" event={"ID":"1fafe594-936f-40ba-9709-a7073fe1c18a","Type":"ContainerStarted","Data":"fa46791ed38c24dc38ee851b9e80d81136738d25b1d4cfa232677acf05e8f7a5"}
Sep 11 13:21:16.205208 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.205162    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl" podStartSLOduration=1.86578634 podStartE2EDuration="4.205145569s" totalImagesPullingTime="2.339359229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:16.204654344 +0000 UTC m=+90.037089482" watchObservedRunningTime="2026-09-11 13:21:16.205145569 +0000 UTC m=+90.037580709"
Sep 11 13:21:16.222151 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.222076    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-p45fg" podStartSLOduration=1.9139889860000001 podStartE2EDuration="4.222060129s" totalImagesPullingTime="2.308071143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:16.221824652 +0000 UTC m=+90.054259795" watchObservedRunningTime="2026-09-11 13:21:16.222060129 +0000 UTC m=+90.054495269"
Sep 11 13:21:16.365783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.365747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:16.365958 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:16.365846    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:16.365958 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:16.365896    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.365882296 +0000 UTC m=+94.198317413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:16.466207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.466133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:16.466207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.466170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:16.466365 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:16.466269    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 13:21:16.466365 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:16.466287    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.466270583 +0000 UTC m=+94.298705700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : configmap references non-existent config key: service-ca.crt
Sep 11 13:21:16.466365 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:16.466338    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.466325626 +0000 UTC m=+94.298760757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : secret "router-metrics-certs-default" not found
Sep 11 13:21:16.786535 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.786509    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"]
Sep 11 13:21:16.789266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.789247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"
Sep 11 13:21:16.793874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.793856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8sgn2\""
Sep 11 13:21:16.794925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.794897    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 13:21:16.795058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.794949    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:16.799358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.799338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:16.809082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.808897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"]
Sep 11 13:21:16.868954 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.868934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw7mv\" (UniqueName: \"kubernetes.io/projected/2654ee51-3bd4-4e48-b03b-ce0926012658-kube-api-access-xw7mv\") pod \"migrator-8b4d697c5-hncbc\" (UID: \"2654ee51-3bd4-4e48-b03b-ce0926012658\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"
Sep 11 13:21:16.897167 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.897145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xh5vk"]
Sep 11 13:21:16.899938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.899921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.906253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.906188    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ndm9r\""
Sep 11 13:21:16.906449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.906193    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 13:21:16.910281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.910264    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 13:21:16.948939 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.948918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xh5vk"]
Sep 11 13:21:16.969353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.969440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw7mv\" (UniqueName: \"kubernetes.io/projected/2654ee51-3bd4-4e48-b03b-ce0926012658-kube-api-access-xw7mv\") pod \"migrator-8b4d697c5-hncbc\" (UID: \"2654ee51-3bd4-4e48-b03b-ce0926012658\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"
Sep 11 13:21:16.969440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc29b0f-3fed-4259-a320-b5e50b74b6cc-crio-socket\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.969440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbcs\" (UniqueName: \"kubernetes.io/projected/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-api-access-2lbcs\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.969440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc29b0f-3fed-4259-a320-b5e50b74b6cc-data-volume\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.969587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.969457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:16.982732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:16.982705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw7mv\" (UniqueName: \"kubernetes.io/projected/2654ee51-3bd4-4e48-b03b-ce0926012658-kube-api-access-xw7mv\") pod \"migrator-8b4d697c5-hncbc\" (UID: \"2654ee51-3bd4-4e48-b03b-ce0926012658\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"
Sep 11 13:21:17.006230 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.006205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:17.070553 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc29b0f-3fed-4259-a320-b5e50b74b6cc-crio-socket\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070553 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbcs\" (UniqueName: \"kubernetes.io/projected/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-api-access-2lbcs\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc29b0f-3fed-4259-a320-b5e50b74b6cc-data-volume\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc29b0f-3fed-4259-a320-b5e50b74b6cc-crio-socket\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.070920 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.070733    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.070920 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.070755    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.070920 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.070802    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:17.570784621 +0000 UTC m=+91.403219752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.070920 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.070823    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:17.570813563 +0000 UTC m=+91.403248679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.070920 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.070895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc29b0f-3fed-4259-a320-b5e50b74b6cc-data-volume\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.097907 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.097885    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"
Sep 11 13:21:17.107580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.107561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbcs\" (UniqueName: \"kubernetes.io/projected/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-api-access-2lbcs\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.163089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.163041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:17.319667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.319636    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:17.377722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.377667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc"]
Sep 11 13:21:17.380684 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:17.380664    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2654ee51_3bd4_4e48_b03b_ce0926012658.slice/crio-52175115ab33bc443d430b3994b0ac9e18d0c181fef23e52925fda1040e9f3e8 WatchSource:0}: Error finding container 52175115ab33bc443d430b3994b0ac9e18d0c181fef23e52925fda1040e9f3e8: Status 404 returned error can't find the container with id 52175115ab33bc443d430b3994b0ac9e18d0c181fef23e52925fda1040e9f3e8
Sep 11 13:21:17.574954 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.574928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.575079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.574986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:17.575079 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.575043    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.575079 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.575077    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.575188 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.575105    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:18.575090575 +0000 UTC m=+92.407525709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.575188 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:17.575124    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:18.575113291 +0000 UTC m=+92.407548424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.715292 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.715225    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:17.887517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:17.887462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:18.062361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:18.062321    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:18.194556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:18.194528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc" event={"ID":"2654ee51-3bd4-4e48-b03b-ce0926012658","Type":"ContainerStarted","Data":"52175115ab33bc443d430b3994b0ac9e18d0c181fef23e52925fda1040e9f3e8"}
Sep 11 13:21:18.585019 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:18.584995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:18.585286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:18.585064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:18.585286 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:18.585107    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:18.585286 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:18.585169    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.585152017 +0000 UTC m=+94.417587153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:18.585286 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:18.585190    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:18.585286 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:18.585244    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.585222112 +0000 UTC m=+94.417657235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:18.637826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:18.637809    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5kb6_b8879b2c-2e02-422e-aea0-3c32776bb894/dns-node-resolver/0.log"
Sep 11 13:21:19.202320 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.202283    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc" event={"ID":"2654ee51-3bd4-4e48-b03b-ce0926012658","Type":"ContainerStarted","Data":"684abc99cecbadc43f280c5630c5294f19a769b1d8b65927633ae7e72846a55a"}
Sep 11 13:21:19.202534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.202380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc" event={"ID":"2654ee51-3bd4-4e48-b03b-ce0926012658","Type":"ContainerStarted","Data":"777ac3b1af5df7bd25984227066629b6e7fdd61606ab9386fdf2039c3165461f"}
Sep 11 13:21:19.222915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.222868    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hncbc" podStartSLOduration=2.095302617 podStartE2EDuration="3.222853613s" totalImagesPullingTime="1.127550996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:19.221855329 +0000 UTC m=+93.054290470" watchObservedRunningTime="2026-09-11 13:21:19.222853613 +0000 UTC m=+93.055288751"
Sep 11 13:21:19.459797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.459711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:19.551405 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.551373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:19.847109 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:19.847082    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx27l_5b3160f1-4933-46df-adff-207d0becf29a/node-ca/0.log"
Sep 11 13:21:20.397716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.397682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:20.397886 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.397817    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:20.397886 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.397879    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.397863947 +0000 UTC m=+102.230299064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:20.435972 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.435950    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cshr4_cac16b1d-9d3d-4856-a189-e9eafad2e4b6/serve-healthcheck-canary/0.log"
Sep 11 13:21:20.498598 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.498574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:20.498598 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.498600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:20.498753 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.498723    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 13:21:20.498753 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.498729    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.498713194 +0000 UTC m=+102.331148333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : configmap references non-existent config key: service-ca.crt
Sep 11 13:21:20.498848 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.498760    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs podName:563d51ca-738f-4f55-b006-aa87c7d5c104 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.498749314 +0000 UTC m=+102.331184434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs") pod "router-default-cbfcdc64b-9rglm" (UID: "563d51ca-738f-4f55-b006-aa87c7d5c104") : secret "router-metrics-certs-default" not found
Sep 11 13:21:20.599852 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.599823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:20.599928 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:20.599897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:20.599974 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.599946    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:20.600013 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.599988    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:20.600013 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.600002    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:24.599986874 +0000 UTC m=+98.432422003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:20.600086 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:20.600022    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:24.600012401 +0000 UTC m=+98.432447535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:21.265016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:21.264983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:21.376661 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:21.376630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:21.573927 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:21.573894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:21.784091 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:21.784059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:21.914410 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:21.914329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:22.320486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:22.320458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:22.534469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:22.534437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.462586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:23.462555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.596038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:23.596006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:23.920312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:23.920282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:24.108971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.108935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:24.188672 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.188603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:24.500962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.500876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:24.627799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.627769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:24.627955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.627857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:24.627955 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:24.627889    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:24.627955 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:24.627952    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:32.6279322 +0000 UTC m=+106.460367339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:24.628114 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:24.627995    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:24.628114 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:24.628062    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls podName:abc29b0f-3fed-4259-a320-b5e50b74b6cc nodeName:}" failed. No retries permitted until 2026-09-11 13:21:32.628048423 +0000 UTC m=+106.460483565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh5vk" (UID: "abc29b0f-3fed-4259-a320-b5e50b74b6cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:24.829579 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.829552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:21:24.831866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.831837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ba1b359-cd4e-445e-8c41-8eb1f504e814-metrics-tls\") pod \"dns-default-bbmkd\" (UID: \"6ba1b359-cd4e-445e-8c41-8eb1f504e814\") " pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:21:24.945436 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.945407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-flkcx\""
Sep 11 13:21:24.953268 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:24.953248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:21:25.028661 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.028634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:25.127725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.127637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:25.229003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.228978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbmkd"]
Sep 11 13:21:25.231828 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:25.231808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba1b359_cd4e_445e_8c41_8eb1f504e814.slice/crio-afd58022216b45ac40926bcf78c0c6e3d3081462b89431f325c74f3515e50a6c WatchSource:0}: Error finding container afd58022216b45ac40926bcf78c0c6e3d3081462b89431f325c74f3515e50a6c: Status 404 returned error can't find the container with id afd58022216b45ac40926bcf78c0c6e3d3081462b89431f325c74f3515e50a6c
Sep 11 13:21:25.324269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.324240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:25.711053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.711010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:25.924590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:25.924539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:26.021110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:26.021035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:26.224906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:26.224872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbmkd" event={"ID":"6ba1b359-cd4e-445e-8c41-8eb1f504e814","Type":"ContainerStarted","Data":"afd58022216b45ac40926bcf78c0c6e3d3081462b89431f325c74f3515e50a6c"}
Sep 11 13:21:26.269484 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:26.269450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:26.403447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:26.403416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.231653 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.231623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbmkd" event={"ID":"6ba1b359-cd4e-445e-8c41-8eb1f504e814","Type":"ContainerStarted","Data":"7bbe24dbcb73e057c84c7eb868e4f63fa6ee6a0299e3a8fded9d6a09e93c41d0"}
Sep 11 13:21:27.231984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.231673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbmkd" event={"ID":"6ba1b359-cd4e-445e-8c41-8eb1f504e814","Type":"ContainerStarted","Data":"03953cc0115f3467e64e0c9446930e7273ce0dfd58ff9d7e82cb0dd3d7351747"}
Sep 11 13:21:27.231984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.231766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:21:27.255460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.255407    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bbmkd" podStartSLOduration=65.449841274 podStartE2EDuration="1m7.255388224s" totalImagesPullingTime="1.80554695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:27.25286136 +0000 UTC m=+101.085296501" watchObservedRunningTime="2026-09-11 13:21:27.255388224 +0000 UTC m=+101.087823364"
Sep 11 13:21:27.308817 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.308750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.674775 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.674697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.763343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.763305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.908584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.908555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:27.993160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:27.993099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:28.096727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.096698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:28.314688 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.314654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:28.456246 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.456208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:28.456379 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:28.456338    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 13:21:28.456421 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:21:28.456402    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert podName:d81c9284-9707-4425-aada-58fc212ab9a5 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:44.456383554 +0000 UTC m=+118.288818685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w7rvc" (UID: "d81c9284-9707-4425-aada-58fc212ab9a5") : secret "networking-console-plugin-cert" not found
Sep 11 13:21:28.556963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.556928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:28.556963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.556965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:28.557538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.557521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/563d51ca-738f-4f55-b006-aa87c7d5c104-service-ca-bundle\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:28.559223 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.559204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/563d51ca-738f-4f55-b006-aa87c7d5c104-metrics-certs\") pod \"router-default-cbfcdc64b-9rglm\" (UID: \"563d51ca-738f-4f55-b006-aa87c7d5c104\") " pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:28.639384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.639330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:28.915389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:28.915304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cbfcdc64b-9rglm"]
Sep 11 13:21:28.919209 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:28.919185    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563d51ca_738f_4f55_b006_aa87c7d5c104.slice/crio-6e013f90589f23b6472e6cb8166f804b064330aa8277d3e2fc02fd22e50632cd WatchSource:0}: Error finding container 6e013f90589f23b6472e6cb8166f804b064330aa8277d3e2fc02fd22e50632cd: Status 404 returned error can't find the container with id 6e013f90589f23b6472e6cb8166f804b064330aa8277d3e2fc02fd22e50632cd
Sep 11 13:21:29.143483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.143457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f4z5l"
Sep 11 13:21:29.238903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.238809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cbfcdc64b-9rglm" event={"ID":"563d51ca-738f-4f55-b006-aa87c7d5c104","Type":"ContainerStarted","Data":"cc27aedfbbc9e5cac03b8493b7c81a9a79864d23ca489632b654830ded2323fd"}
Sep 11 13:21:29.238903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.238874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cbfcdc64b-9rglm" event={"ID":"563d51ca-738f-4f55-b006-aa87c7d5c104","Type":"ContainerStarted","Data":"6e013f90589f23b6472e6cb8166f804b064330aa8277d3e2fc02fd22e50632cd"}
Sep 11 13:21:29.263482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.263427    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cbfcdc64b-9rglm" podStartSLOduration=17.263407859 podStartE2EDuration="17.263407859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:29.262113868 +0000 UTC m=+103.094549008" watchObservedRunningTime="2026-09-11 13:21:29.263407859 +0000 UTC m=+103.095843004"
Sep 11 13:21:29.305907 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.305880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:29.640360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.640326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:29.642994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.642973    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:29.707966 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.707935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:29.835719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.835692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:29.914550 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:29.914468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:30.103402 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:30.103376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:30.242591 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:30.242520    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:30.243736 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:30.243717    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cbfcdc64b-9rglm"
Sep 11 13:21:30.493044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:30.492968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:31.295211 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:31.295180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:31.490886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:31.490852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:31.694839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:31.694760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:31.905070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:31.905043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:32.690040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:32.690003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:32.690406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:32.690065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:32.690543 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:32.690524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc29b0f-3fed-4259-a320-b5e50b74b6cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:32.692245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:32.692226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc29b0f-3fed-4259-a320-b5e50b74b6cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh5vk\" (UID: \"abc29b0f-3fed-4259-a320-b5e50b74b6cc\") " pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:32.808774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:32.808740    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xh5vk"
Sep 11 13:21:33.083486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:33.081976    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xh5vk"]
Sep 11 13:21:33.087152 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:33.087127    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc29b0f_3fed_4259_a320_b5e50b74b6cc.slice/crio-80ecbbd30615dc7d6e5024ebb318b98521281b7b23cc5409c6bb3d34c6d604ff WatchSource:0}: Error finding container 80ecbbd30615dc7d6e5024ebb318b98521281b7b23cc5409c6bb3d34c6d604ff: Status 404 returned error can't find the container with id 80ecbbd30615dc7d6e5024ebb318b98521281b7b23cc5409c6bb3d34c6d604ff
Sep 11 13:21:33.251971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:33.251936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh5vk" event={"ID":"abc29b0f-3fed-4259-a320-b5e50b74b6cc","Type":"ContainerStarted","Data":"8174de13963281f16e0886bfe5cc546b49d528c1a4f1b794f4a578066fab70ec"}
Sep 11 13:21:33.252099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:33.251994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh5vk" event={"ID":"abc29b0f-3fed-4259-a320-b5e50b74b6cc","Type":"ContainerStarted","Data":"80ecbbd30615dc7d6e5024ebb318b98521281b7b23cc5409c6bb3d34c6d604ff"}
Sep 11 13:21:34.257033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:34.256998    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh5vk" event={"ID":"abc29b0f-3fed-4259-a320-b5e50b74b6cc","Type":"ContainerStarted","Data":"9b14c1d56c611a0f0a79c92a2876c6d2ee44d6d9f4c462e0024cb43beabcfb70"}
Sep 11 13:21:34.909329 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:34.909295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:34.984072 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:34.984038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:35.262045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:35.262022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh5vk" event={"ID":"abc29b0f-3fed-4259-a320-b5e50b74b6cc","Type":"ContainerStarted","Data":"5861d6c132d46cc67c147866965c2903fb0cc8c37bdc39baf54e058235d2593e"}
Sep 11 13:21:35.294251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:35.294167    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xh5vk" podStartSLOduration=17.304076475 podStartE2EDuration="19.294148641s" totalImagesPullingTime="1.990072166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:21:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:35.292675218 +0000 UTC m=+109.125110357" watchObservedRunningTime="2026-09-11 13:21:35.294148641 +0000 UTC m=+109.126583781"
Sep 11 13:21:37.236738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:37.236704    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bbmkd"
Sep 11 13:21:41.557388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.557358    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f5dd664d6-l9v4p"]
Sep 11 13:21:41.560268 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.560253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.569467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.569448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 13:21:41.570665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.570648    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 13:21:41.570820 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.570801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 13:21:41.570909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.570881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g6rbf\""
Sep 11 13:21:41.579153 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.579135    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 13:21:41.608822 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.608796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5dd664d6-l9v4p"]
Sep 11 13:21:41.655117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-trusted-ca\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655198 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-tls\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655198 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfcg\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-kube-api-access-9cfcg\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-installation-pull-secrets\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/967c4de4-e4ab-4bc7-9c41-5c226effaea2-ca-trust-extracted\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-certificates\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-bound-sa-token\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.655399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.655359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-image-registry-private-configuration\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-image-registry-private-configuration\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-trusted-ca\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-tls\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfcg\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-kube-api-access-9cfcg\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-installation-pull-secrets\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/967c4de4-e4ab-4bc7-9c41-5c226effaea2-ca-trust-extracted\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-certificates\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.756580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-bound-sa-token\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.757036 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.756998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/967c4de4-e4ab-4bc7-9c41-5c226effaea2-ca-trust-extracted\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.757334 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.757303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-trusted-ca\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.757575 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.757552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-certificates\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.758816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.758797    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-image-registry-private-configuration\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.758960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.758934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/967c4de4-e4ab-4bc7-9c41-5c226effaea2-installation-pull-secrets\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.759051 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.759036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-registry-tls\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.790342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.790312    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfcg\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-kube-api-access-9cfcg\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.790416 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.790323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/967c4de4-e4ab-4bc7-9c41-5c226effaea2-bound-sa-token\") pod \"image-registry-7f5dd664d6-l9v4p\" (UID: \"967c4de4-e4ab-4bc7-9c41-5c226effaea2\") " pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.868168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.868127    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:41.975421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:41.975387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:42.191534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.191511    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5dd664d6-l9v4p"]
Sep 11 13:21:42.192930 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:42.192902    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967c4de4_e4ab_4bc7_9c41_5c226effaea2.slice/crio-59d765974351e2392e98abdd17da12e7fc2e5485e77dd8b10013f3cd6686fde9 WatchSource:0}: Error finding container 59d765974351e2392e98abdd17da12e7fc2e5485e77dd8b10013f3cd6686fde9: Status 404 returned error can't find the container with id 59d765974351e2392e98abdd17da12e7fc2e5485e77dd8b10013f3cd6686fde9
Sep 11 13:21:42.284567 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.284530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p" event={"ID":"967c4de4-e4ab-4bc7-9c41-5c226effaea2","Type":"ContainerStarted","Data":"c0c6849d28a1b8ae85bb029905e1031f7ee6688a4ea397782f2061257d3aa689"}
Sep 11 13:21:42.284717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.284580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p" event={"ID":"967c4de4-e4ab-4bc7-9c41-5c226effaea2","Type":"ContainerStarted","Data":"59d765974351e2392e98abdd17da12e7fc2e5485e77dd8b10013f3cd6686fde9"}
Sep 11 13:21:42.284717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.284659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:21:42.348681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.348644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:42.425915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.425849    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p" podStartSLOduration=1.425828188 podStartE2EDuration="1.425828188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:42.424432624 +0000 UTC m=+116.256867763" watchObservedRunningTime="2026-09-11 13:21:42.425828188 +0000 UTC m=+116.258263328"
Sep 11 13:21:42.683672 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:42.683643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:43.093050 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:43.093021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:43.301043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:43.301007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:43.435009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:43.434939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:43.958894 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:43.958857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:44.082327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.082299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:44.215132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.215054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:44.367694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.367664    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:44.476445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.476341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:44.478738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.478721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d81c9284-9707-4425-aada-58fc212ab9a5-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w7rvc\" (UID: \"d81c9284-9707-4425-aada-58fc212ab9a5\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:44.716416 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.716381    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"
Sep 11 13:21:44.989057 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:44.988981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc"]
Sep 11 13:21:44.992880 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:44.992853    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81c9284_9707_4425_aada_58fc212ab9a5.slice/crio-b863215139eb70d08b18747f3c6850bf0d764447146c2e109453e42cc60e5b46 WatchSource:0}: Error finding container b863215139eb70d08b18747f3c6850bf0d764447146c2e109453e42cc60e5b46: Status 404 returned error can't find the container with id b863215139eb70d08b18747f3c6850bf0d764447146c2e109453e42cc60e5b46
Sep 11 13:21:45.294905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:45.294874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc" event={"ID":"d81c9284-9707-4425-aada-58fc212ab9a5","Type":"ContainerStarted","Data":"b863215139eb70d08b18747f3c6850bf0d764447146c2e109453e42cc60e5b46"}
Sep 11 13:21:45.937272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:45.937227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:46.010373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:46.010332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:46.299912 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:46.299881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc" event={"ID":"d81c9284-9707-4425-aada-58fc212ab9a5","Type":"ContainerStarted","Data":"29e8be82a35bad5ed0f6d6b0a2bcf60cb17283bb567a094b56f5305e51447eb4"}
Sep 11 13:21:46.319946 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:46.319903    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w7rvc" podStartSLOduration=33.130085044 podStartE2EDuration="34.319889421s" totalImagesPullingTime="1.189804377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:46.319147517 +0000 UTC m=+120.151582656" watchObservedRunningTime="2026-09-11 13:21:46.319889421 +0000 UTC m=+120.152324553"
Sep 11 13:21:46.446447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:46.446375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:46.563149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:46.563098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:47.960592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:47.960564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:48.039686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:48.039657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:48.136177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:48.136133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:49.473459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:49.473426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:49.546549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:49.546489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:50.483458 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:50.483422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:50.551307 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:50.551275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:51.611837 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:51.611796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:51.973788 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:51.973699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:52.057580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.057551    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"]
Sep 11 13:21:52.060980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.060964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.066905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.066885    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 13:21:52.067017 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.066891    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 13:21:52.067641 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.067616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 13:21:52.067892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.067872    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 13:21:52.067892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.067886    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dh9zn\""
Sep 11 13:21:52.068032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.067994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 13:21:52.072745 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.072724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"]
Sep 11 13:21:52.099886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.099860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:52.132592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.132566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n7f\" (UniqueName: \"kubernetes.io/projected/ba054409-9d22-4696-ae83-6a114cda177c-kube-api-access-r5n7f\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.132683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.132599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.132683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.132623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba054409-9d22-4696-ae83-6a114cda177c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.132761 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.132700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.233009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.232955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.233009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.232986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba054409-9d22-4696-ae83-6a114cda177c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.233131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.233018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.233131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.233054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n7f\" (UniqueName: \"kubernetes.io/projected/ba054409-9d22-4696-ae83-6a114cda177c-kube-api-access-r5n7f\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.233726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.233702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba054409-9d22-4696-ae83-6a114cda177c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.235400 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.235377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.235522 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.235415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ba054409-9d22-4696-ae83-6a114cda177c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.243358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.243325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n7f\" (UniqueName: \"kubernetes.io/projected/ba054409-9d22-4696-ae83-6a114cda177c-kube-api-access-r5n7f\") pod \"prometheus-operator-68bcd7f987-fsmvx\" (UID: \"ba054409-9d22-4696-ae83-6a114cda177c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.367973 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.367943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:52.369863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.369850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"
Sep 11 13:21:52.638485 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:52.638458    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx"]
Sep 11 13:21:52.641321 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:52.641298    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba054409_9d22_4696_ae83_6a114cda177c.slice/crio-a1255f30ea02e33f81f040c784a62961b5f2a6fbe6cbe81b0e994456546d33b3 WatchSource:0}: Error finding container a1255f30ea02e33f81f040c784a62961b5f2a6fbe6cbe81b0e994456546d33b3: Status 404 returned error can't find the container with id a1255f30ea02e33f81f040c784a62961b5f2a6fbe6cbe81b0e994456546d33b3
Sep 11 13:21:53.326337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:53.326300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx" event={"ID":"ba054409-9d22-4696-ae83-6a114cda177c","Type":"ContainerStarted","Data":"a1255f30ea02e33f81f040c784a62961b5f2a6fbe6cbe81b0e994456546d33b3"}
Sep 11 13:21:53.984193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:53.984157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:54.085668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:54.085638    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:54.190681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:54.190596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:54.331150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:54.331112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx" event={"ID":"ba054409-9d22-4696-ae83-6a114cda177c","Type":"ContainerStarted","Data":"68192b3c6ee8b490aa853f764f9628cbe257d72c428fa69dee5cf8a0f3a9130c"}
Sep 11 13:21:54.331336 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:54.331165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx" event={"ID":"ba054409-9d22-4696-ae83-6a114cda177c","Type":"ContainerStarted","Data":"c631aa0df5486d7a70c6c0218136b6017dd64809bd0e1e25cb07af9510102052"}
Sep 11 13:21:54.350978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:54.350930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fsmvx" podStartSLOduration=1.098027968 podStartE2EDuration="2.350913365s" totalImagesPullingTime="1.252885397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:54.349306066 +0000 UTC m=+128.181741205" watchObservedRunningTime="2026-09-11 13:21:54.350913365 +0000 UTC m=+128.183348503"
Sep 11 13:21:56.152843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.152781    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.364661 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.364634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:21:56.366914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.366889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/998f2146-c7a8-4ee3-9a56-a0a3f1ae8356-metrics-certs\") pod \"network-metrics-daemon-vjjx9\" (UID: \"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356\") " pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:21:56.441183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.441108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.461632 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.461614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2xgs9\""
Sep 11 13:21:56.469915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.469898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vjjx9"
Sep 11 13:21:56.543896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.543871    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2mfrp"]
Sep 11 13:21:56.546187 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.546171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.557699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.557678    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 13:21:56.557874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.557857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 13:21:56.557959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.557861    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4pnf\""
Sep 11 13:21:56.557959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.557920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 13:21:56.656521 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.656478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.667704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.667817 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-tls\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.667817 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-root\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.667934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-wtmp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.667934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwqjp\" (UniqueName: \"kubernetes.io/projected/0f1fece1-c276-4260-8074-04656cff759a-kube-api-access-lwqjp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.667934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.668079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-textfile\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.668079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.667986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-metrics-client-ca\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.668079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.668011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-sys\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.748847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.748770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vjjx9"]
Sep 11 13:21:56.752237 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:56.752208    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998f2146_c7a8_4ee3_9a56_a0a3f1ae8356.slice/crio-43030a5ed54899990aea4e339913aedea1d8a47486cde089a78fdd782de84424 WatchSource:0}: Error finding container 43030a5ed54899990aea4e339913aedea1d8a47486cde089a78fdd782de84424: Status 404 returned error can't find the container with id 43030a5ed54899990aea4e339913aedea1d8a47486cde089a78fdd782de84424
Sep 11 13:21:56.768494 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-sys\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.768602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.768602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-tls\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.768602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-sys\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.768602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-root\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.768602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-wtmp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwqjp\" (UniqueName: \"kubernetes.io/projected/0f1fece1-c276-4260-8074-04656cff759a-kube-api-access-lwqjp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-root\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-textfile\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-metrics-client-ca\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.768770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-wtmp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769058 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.769030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-textfile\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769405 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.769074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.769405 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.769187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f1fece1-c276-4260-8074-04656cff759a-metrics-client-ca\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.770945 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.770922    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-tls\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.771023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.770932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f1fece1-c276-4260-8074-04656cff759a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.778417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.778397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwqjp\" (UniqueName: \"kubernetes.io/projected/0f1fece1-c276-4260-8074-04656cff759a-kube-api-access-lwqjp\") pod \"node-exporter-2mfrp\" (UID: \"0f1fece1-c276-4260-8074-04656cff759a\") " pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.787377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.787350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:56.854546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.854528    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2mfrp"
Sep 11 13:21:56.863867 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:56.863847    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1fece1_c276_4260_8074_04656cff759a.slice/crio-791a1db7b683eaac39aff7245cd930501705ddece81dfde8c904576b63fa5d75 WatchSource:0}: Error finding container 791a1db7b683eaac39aff7245cd930501705ddece81dfde8c904576b63fa5d75: Status 404 returned error can't find the container with id 791a1db7b683eaac39aff7245cd930501705ddece81dfde8c904576b63fa5d75
Sep 11 13:21:56.892015 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:56.891988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.344286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.344245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mfrp" event={"ID":"0f1fece1-c276-4260-8074-04656cff759a","Type":"ContainerStarted","Data":"791a1db7b683eaac39aff7245cd930501705ddece81dfde8c904576b63fa5d75"}
Sep 11 13:21:57.345670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.345628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.345793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.345720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjjx9" event={"ID":"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356","Type":"ContainerStarted","Data":"43030a5ed54899990aea4e339913aedea1d8a47486cde089a78fdd782de84424"}
Sep 11 13:21:57.488779 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.488739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.609444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.609367    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:21:57.612581 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.612548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.615572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.615525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 13:21:57.615694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.615533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 13:21:57.615984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.615961    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4fcc5\""
Sep 11 13:21:57.616476 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 13:21:57.616643 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616601    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 13:21:57.616749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616607    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 13:21:57.616749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616740    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 13:21:57.616749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616747    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 13:21:57.616910 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.616874    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 13:21:57.619414 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.619350    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 13:21:57.646388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.646136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.660145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.660117    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:21:57.676546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lfsc\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.676891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.677163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.677163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.676936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.777970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.777987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lfsc\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.778489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.778345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.781397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.781369    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.781542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.781448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.781619 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.781542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.781619 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.781547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.782158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.782110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.782570 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.782522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.782662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.782604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.782662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.782608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.783181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.783093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.783698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.783675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.784290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.784270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.802865 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.802843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lfsc\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc\") pod \"alertmanager-main-0\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:57.879663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.879585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:57.924254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:57.924221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:21:58.086880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.086845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:58.351452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.351422    2582 generic.go:356] "Generic (PLEG): container finished" podID="0f1fece1-c276-4260-8074-04656cff759a" containerID="03b91d560f80b08b65da167831c0df970d8df4a5b84bcd47a2ce175eb51d462b" exitCode=0
Sep 11 13:21:58.351847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.351529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mfrp" event={"ID":"0f1fece1-c276-4260-8074-04656cff759a","Type":"ContainerDied","Data":"03b91d560f80b08b65da167831c0df970d8df4a5b84bcd47a2ce175eb51d462b"}
Sep 11 13:21:58.353912 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.353889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjjx9" event={"ID":"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356","Type":"ContainerStarted","Data":"79c2672b83d9791899c729715794eca81b0ffe0cf0da99e1c713ab055ad636a0"}
Sep 11 13:21:58.354008 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.353934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vjjx9" event={"ID":"998f2146-c7a8-4ee3-9a56-a0a3f1ae8356","Type":"ContainerStarted","Data":"68620035e8daa934325a58740487a774ee7110f0e9a6c9eefd7e698f57b452d1"}
Sep 11 13:21:58.435695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.435670    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:21:58.438931 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:21:58.438905    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438ded42_4e85_4fcb_826c_30c498551a31.slice/crio-3bf46043dd8dcd06740859fa45c04bacfca2eef3fe4b12a0782b7924e22b3a13 WatchSource:0}: Error finding container 3bf46043dd8dcd06740859fa45c04bacfca2eef3fe4b12a0782b7924e22b3a13: Status 404 returned error can't find the container with id 3bf46043dd8dcd06740859fa45c04bacfca2eef3fe4b12a0782b7924e22b3a13
Sep 11 13:21:58.600973 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.600923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vjjx9" podStartSLOduration=130.249794308 podStartE2EDuration="2m11.60090575s" totalImagesPullingTime="1.351111442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:58.599890028 +0000 UTC m=+132.432325167" watchObservedRunningTime="2026-09-11 13:21:58.60090575 +0000 UTC m=+132.433340889"
Sep 11 13:21:58.944561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:58.944528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:59.084667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.084631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:21:59.362048 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.362002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mfrp" event={"ID":"0f1fece1-c276-4260-8074-04656cff759a","Type":"ContainerStarted","Data":"62fb6dc41438772b63dd0fbb0f59ef67f18298b26f46aa340efb05fb44f98dfe"}
Sep 11 13:21:59.362485 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.362076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mfrp" event={"ID":"0f1fece1-c276-4260-8074-04656cff759a","Type":"ContainerStarted","Data":"816fe88698a574feaf2dc6c2a45e9b1372aaf3e30c1c1345d41c2528a0304883"}
Sep 11 13:21:59.363299 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.363274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"3bf46043dd8dcd06740859fa45c04bacfca2eef3fe4b12a0782b7924e22b3a13"}
Sep 11 13:21:59.409811 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.409767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2mfrp" podStartSLOduration=2.095577181 podStartE2EDuration="3.409750317s" totalImagesPullingTime="1.242286107s" totalInitContainerRuntime="71.887029ms" isStatefulPod=true podCreationTimestamp="2026-09-11 13:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:59.40879166 +0000 UTC m=+133.241226798" watchObservedRunningTime="2026-09-11 13:21:59.409750317 +0000 UTC m=+133.242185457"
Sep 11 13:21:59.714429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.714364    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"]
Sep 11 13:21:59.717786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.717771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.739815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.739763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 13:21:59.739815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.739796    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 13:21:59.740042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.740029    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 13:21:59.740109 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.740084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 13:21:59.740165 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.740110    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6sbdd\""
Sep 11 13:21:59.740235 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.740217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 13:21:59.740316 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.740301    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dtql8vremav89\""
Sep 11 13:21:59.755193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.755162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"]
Sep 11 13:21:59.793181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk264\" (UniqueName: \"kubernetes.io/projected/fbfea1bb-c613-4698-ace9-490e8ca8bc48-kube-api-access-nk264\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfea1bb-c613-4698-ace9-490e8ca8bc48-metrics-client-ca\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-grpc-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.793409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.793369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.893837 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.893811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.893935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.893847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.893935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.893876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.894038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.893998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk264\" (UniqueName: \"kubernetes.io/projected/fbfea1bb-c613-4698-ace9-490e8ca8bc48-kube-api-access-nk264\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.894088 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.894074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.894136 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.894110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfea1bb-c613-4698-ace9-490e8ca8bc48-metrics-client-ca\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.894183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.894165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-grpc-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.894230 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.894198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.895090 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.895061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfea1bb-c613-4698-ace9-490e8ca8bc48-metrics-client-ca\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.896551 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.896525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.896811 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.896788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-grpc-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.897138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.897118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.897287 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.897267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.897371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.897350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.897423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.897409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fbfea1bb-c613-4698-ace9-490e8ca8bc48-secret-thanos-querier-tls\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:21:59.907854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:21:59.907836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk264\" (UniqueName: \"kubernetes.io/projected/fbfea1bb-c613-4698-ace9-490e8ca8bc48-kube-api-access-nk264\") pod \"thanos-querier-7f6c5f5fb8-m257h\" (UID: \"fbfea1bb-c613-4698-ace9-490e8ca8bc48\") " pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:22:00.025897 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.025873    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:22:00.310718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.310650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:00.334089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.334064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"]
Sep 11 13:22:00.336836 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:22:00.336813    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfea1bb_c613_4698_ace9_490e8ca8bc48.slice/crio-573d4539a3cf85d2790b95a0a1b05613bb7a0a94954622dc7a46ff1b8f2cf22c WatchSource:0}: Error finding container 573d4539a3cf85d2790b95a0a1b05613bb7a0a94954622dc7a46ff1b8f2cf22c: Status 404 returned error can't find the container with id 573d4539a3cf85d2790b95a0a1b05613bb7a0a94954622dc7a46ff1b8f2cf22c
Sep 11 13:22:00.368724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.368699    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e" exitCode=0
Sep 11 13:22:00.369044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.368763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"}
Sep 11 13:22:00.370938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.370915    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"573d4539a3cf85d2790b95a0a1b05613bb7a0a94954622dc7a46ff1b8f2cf22c"}
Sep 11 13:22:00.519247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.519207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:00.712570 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.712474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:00.951071 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.951036    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6788766cc4-v8vxf"]
Sep 11 13:22:00.956732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.956708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:00.959768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.959746    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 13:22:00.959903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.959885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f049urv3452ic\""
Sep 11 13:22:00.960029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.959979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xtgqw\""
Sep 11 13:22:00.960029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.959979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 13:22:00.960165 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.960123    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 13:22:00.966887 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.966870    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 13:22:00.973038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:00.973016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6788766cc4-v8vxf"]
Sep 11 13:22:01.104176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-client-certs\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-metrics-server-audit-profiles\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkw6v\" (UniqueName: \"kubernetes.io/projected/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-kube-api-access-xkw6v\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-audit-log\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-tls\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.104592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.104456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-client-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205073 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-client-certs\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-metrics-server-audit-profiles\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkw6v\" (UniqueName: \"kubernetes.io/projected/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-kube-api-access-xkw6v\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-audit-log\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-tls\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-client-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.205902 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-audit-log\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.206020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.205956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.206266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.206233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-metrics-server-audit-profiles\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.208160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.208130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-client-certs\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.208276 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.208194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-client-ca-bundle\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.208475 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.208456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-secret-metrics-server-tls\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.237065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.237013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkw6v\" (UniqueName: \"kubernetes.io/projected/ff0504bb-9d84-4d9d-9adb-492c5bbd66f4-kube-api-access-xkw6v\") pod \"metrics-server-6788766cc4-v8vxf\" (UID: \"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4\") " pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.265599 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.265572    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:01.265790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.265775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:01.400006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.399972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:01.580623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.580588    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6788766cc4-v8vxf"]
Sep 11 13:22:01.583063 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:22:01.583032    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0504bb_9d84_4d9d_9adb_492c5bbd66f4.slice/crio-8f39f2236952968c39ae60bf7f846bea8db4db3cca4c132b5a7fe2c20228d434 WatchSource:0}: Error finding container 8f39f2236952968c39ae60bf7f846bea8db4db3cca4c132b5a7fe2c20228d434: Status 404 returned error can't find the container with id 8f39f2236952968c39ae60bf7f846bea8db4db3cca4c132b5a7fe2c20228d434
Sep 11 13:22:01.583882 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:01.583854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:02.379831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:02.379782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf" event={"ID":"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4","Type":"ContainerStarted","Data":"8f39f2236952968c39ae60bf7f846bea8db4db3cca4c132b5a7fe2c20228d434"}
Sep 11 13:22:02.997864 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:02.997828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:03.092666 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.092632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:03.293207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.293172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5dd664d6-l9v4p"
Sep 11 13:22:03.389693 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.389657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"}
Sep 11 13:22:03.389884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.389780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"}
Sep 11 13:22:03.389884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.389828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"}
Sep 11 13:22:03.389884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.389867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"}
Sep 11 13:22:03.390043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.389900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"}
Sep 11 13:22:03.392286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.392250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"3b04d2e8a79cfc4aaef7ca405c81d60db991caabe57c6ee9ca248195e3f4d4c7"}
Sep 11 13:22:03.392406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.392317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"94103fc0c050e53f4b5955b98b42f32913aad7431df888f9729a6c45464e23bf"}
Sep 11 13:22:03.392406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.392360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"6a80cdb5aba4a5c612260401034223425fa35d2f28ceac8b1d6f955d554ece73"}
Sep 11 13:22:03.610077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.609955    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:03.892776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:03.892676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:04.398420 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:04.398377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf" event={"ID":"ff0504bb-9d84-4d9d-9adb-492c5bbd66f4","Type":"ContainerStarted","Data":"b9efcdd70a33e73b78378ab5117b80a570b16894fec5a59467f2146d672348aa"}
Sep 11 13:22:04.402141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:04.402060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerStarted","Data":"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"}
Sep 11 13:22:04.405273 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:04.405244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"548abea18b8004de208e6859d11a102f83d6d06ff457be4e673c4609ed703b65"}
Sep 11 13:22:04.693572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:04.693540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:04.946602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:04.946495    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf" podStartSLOduration=2.828714463 podStartE2EDuration="4.946477883s" totalImagesPullingTime="2.11776342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:04.945376518 +0000 UTC m=+138.777811658" watchObservedRunningTime="2026-09-11 13:22:04.946477883 +0000 UTC m=+138.778913027"
Sep 11 13:22:05.060935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.060904    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:22:05.064747 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.064729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.081325 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.081295    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-grpc-tls-1sjqa4d8h3ob9\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1sjqa4d8h3ob9\"" type="*v1.Secret"
Sep 11 13:22:05.084257 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.084213    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-1\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap"
Sep 11 13:22:05.084339 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.084291    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-tls-assets-0\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret"
Sep 11 13:22:05.084827 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.084807    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-thanos-sidecar-tls\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret"
Sep 11 13:22:05.092527 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092485    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-dockercfg-rgv96\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rgv96\"" type="*v1.Secret"
Sep 11 13:22:05.092527 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092497    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092529    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-thanos-prometheus-http-client-file\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092543    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-client-certs\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092557    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-web-config\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092611    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-tls\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092660    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-k8s-kube-rbac-proxy-web\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret"
Sep 11 13:22:05.092719 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092683    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-2\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap"
Sep 11 13:22:05.092935 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.092863    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-k8s-rulefiles-0\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap"
Sep 11 13:22:05.093285 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.093267    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"prometheus-trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap"
Sep 11 13:22:05.118102 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.118072    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"serving-certs-ca-bundle\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap"
Sep 11 13:22:05.118102 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:05.118079    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret"
Sep 11 13:22:05.142435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142656 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142656 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjl2\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142656 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.142980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.143193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.142984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.143193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.143016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.143193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.143041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.143193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.143058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.243967 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.243892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.243967 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.243930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.243967 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.243957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.243992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjl2\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.244707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.245045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244745    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.245045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.244810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.246615 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.246595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.265298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.265253    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.6634298640000003 podStartE2EDuration="8.265239956s" totalImagesPullingTime="4.58611365s" totalInitContainerRuntime="15.696442ms" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:05.179289082 +0000 UTC m=+139.011724221" watchObservedRunningTime="2026-09-11 13:22:05.265239956 +0000 UTC m=+139.097675095"
Sep 11 13:22:05.266319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.266303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:22:05.271888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.271871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjl2\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.394729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.394695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:05.411990 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.411959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"52c8990f9df43c10b07ec5afaae4a86f17e31c0373cd3b3e358e6fc0da782e76"}
Sep 11 13:22:05.412367 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.412035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" event={"ID":"fbfea1bb-c613-4698-ace9-490e8ca8bc48","Type":"ContainerStarted","Data":"7c9abc5bd872297c170910a7e2420d1146a097b8c6d1b24b0db3d3dff3d0d973"}
Sep 11 13:22:05.412367 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.412161    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:22:05.463294 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.463237    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h" podStartSLOduration=2.732820224 podStartE2EDuration="6.463215685s" totalImagesPullingTime="3.730395461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:05.45990047 +0000 UTC m=+139.292335610" watchObservedRunningTime="2026-09-11 13:22:05.463215685 +0000 UTC m=+139.295650826"
Sep 11 13:22:05.521637 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.521564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:05.911062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.911033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 13:22:05.917552 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.917528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:05.955305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.955281    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 13:22:05.966973 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:05.966954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.038124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.038102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 13:22:06.043482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.043462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 13:22:06.045291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.045268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.046750 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.046729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.070442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.070421    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 13:22:06.076528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.076490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.077766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.077748    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 13:22:06.085702 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.085679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.102275 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.102254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 13:22:06.105674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.105655    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 13:22:06.107575 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.107549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.116810 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.116783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244843    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-grpc-tls-1sjqa4d8h3ob9: failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244861    2582 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-1: failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244864    2582 configmap.go:193] Couldn't get configMap openshift-monitoring/serving-certs-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244881    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s: failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244846    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-k8s-thanos-sidecar-tls: failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244910    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1 podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.744896321 +0000 UTC m=+140.577331438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-1" (UniqueName: "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:22:06.244919 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244923    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.74491653 +0000 UTC m=+140.577351647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-grpc-tls" (UniqueName: "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.244935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244940    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.744926842 +0000 UTC m=+140.577361959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244943    2582 secret.go:189] Couldn't get secret openshift-monitoring/metrics-client-certs: failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244981    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.744970244 +0000 UTC m=+140.577405361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "configmap-serving-certs-ca-bundle" (UniqueName: "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.244992    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.74498628 +0000 UTC m=+140.577421397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-prometheus-k8s-thanos-sidecar-tls" (UniqueName: "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.245253 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:22:06.245007    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs podName:95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:06.744998492 +0000 UTC m=+140.577433616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-metrics-client-certs" (UniqueName: "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs") pod "prometheus-k8s-0" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4") : failed to sync secret cache: timed out waiting for the condition
Sep 11 13:22:06.246953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.246929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.313916 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.313895    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 13:22:06.330331 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.330315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 13:22:06.336853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.336837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 13:22:06.529904 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.529881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 13:22:06.553470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.553450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1sjqa4d8h3ob9\""
Sep 11 13:22:06.568846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.568823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rgv96\""
Sep 11 13:22:06.670310 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.670287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 13:22:06.758401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.758530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.758530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.758643 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.758692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.758750 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.758737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.759215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.759188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.759301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.759266    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.760979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.760958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.761067 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.760966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.761323 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.761308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.761360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.761323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:06.874492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:06.874423    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:07.164573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.164550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:22:07.166595 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:22:07.166560    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fd7fc5_bc91_49e3_b77d_f04cbe6edfc4.slice/crio-4f1e6568b019a6eebcf2922d881ef56f7d59955eeac2b669193b261adc08e33d WatchSource:0}: Error finding container 4f1e6568b019a6eebcf2922d881ef56f7d59955eeac2b669193b261adc08e33d: Status 404 returned error can't find the container with id 4f1e6568b019a6eebcf2922d881ef56f7d59955eeac2b669193b261adc08e33d
Sep 11 13:22:07.317891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.317862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:07.421821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.421771    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb" exitCode=0
Sep 11 13:22:07.421821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.421802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"}
Sep 11 13:22:07.421948 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.421859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"4f1e6568b019a6eebcf2922d881ef56f7d59955eeac2b669193b261adc08e33d"}
Sep 11 13:22:07.453032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.453006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:07.556268 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:07.556236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:09.957943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:09.957885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:10.032702 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:10.032661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:11.423726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.423699    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f6c5f5fb8-m257h"
Sep 11 13:22:11.443478 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"}
Sep 11 13:22:11.443614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"}
Sep 11 13:22:11.443614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"}
Sep 11 13:22:11.443614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"}
Sep 11 13:22:11.443716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"}
Sep 11 13:22:11.443716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.443652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerStarted","Data":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"}
Sep 11 13:22:11.556858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.556784    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.455401133 podStartE2EDuration="7.556758647s" totalImagesPullingTime="3.080169375s" totalInitContainerRuntime="21.188139ms" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:11.55595498 +0000 UTC m=+145.388390120" watchObservedRunningTime="2026-09-11 13:22:11.556758647 +0000 UTC m=+145.389193791"
Sep 11 13:22:11.876168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:11.876139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:22:12.054210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:12.054177    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:12.292178 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:12.292144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:13.026018 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:13.025990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:13.127583 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:13.127550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:16.168771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:16.168736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:16.269077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:16.269052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:16.372431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:16.372404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:18.306404 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:18.306371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:18.370960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:18.370934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:18.449361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:18.449304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:19.895681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:19.895647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:19.996280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:19.996247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:21.266680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:21.266644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:21.267035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:21.266727    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:31.532470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:31.532439    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fafe594-936f-40ba-9709-a7073fe1c18a" containerID="fa46791ed38c24dc38ee851b9e80d81136738d25b1d4cfa232677acf05e8f7a5" exitCode=0
Sep 11 13:22:31.532860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:31.532529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-p45fg" event={"ID":"1fafe594-936f-40ba-9709-a7073fe1c18a","Type":"ContainerDied","Data":"fa46791ed38c24dc38ee851b9e80d81136738d25b1d4cfa232677acf05e8f7a5"}
Sep 11 13:22:31.532860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:31.532820    2582 scope.go:117] "RemoveContainer" containerID="fa46791ed38c24dc38ee851b9e80d81136738d25b1d4cfa232677acf05e8f7a5"
Sep 11 13:22:32.190250 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:32.190208    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbmkd_6ba1b359-cd4e-445e-8c41-8eb1f504e814/dns/0.log"
Sep 11 13:22:32.199272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:32.199250    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbmkd_6ba1b359-cd4e-445e-8c41-8eb1f504e814/kube-rbac-proxy/0.log"
Sep 11 13:22:32.538668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:32.538634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-p45fg" event={"ID":"1fafe594-936f-40ba-9709-a7073fe1c18a","Type":"ContainerStarted","Data":"67106618bfff32d5c1c754b7cb18e30f8d9ddf8453f16d44fe5a2ea1de40ee11"}
Sep 11 13:22:32.587092 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:32.587068    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5kb6_b8879b2c-2e02-422e-aea0-3c32776bb894/dns-node-resolver/0.log"
Sep 11 13:22:33.142354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:33.142320    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:33.297378 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:33.297347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:36.555782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:36.555749    2582 generic.go:356] "Generic (PLEG): container finished" podID="45aae79c-25ad-41db-9623-c5a41c3f3620" containerID="6b411513d9529ca45f502d5ee99b98769a06aac0e7c76cbff2f97905a238d940" exitCode=0
Sep 11 13:22:36.556175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:36.555812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl" event={"ID":"45aae79c-25ad-41db-9623-c5a41c3f3620","Type":"ContainerDied","Data":"6b411513d9529ca45f502d5ee99b98769a06aac0e7c76cbff2f97905a238d940"}
Sep 11 13:22:36.556175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:36.556104    2582 scope.go:117] "RemoveContainer" containerID="6b411513d9529ca45f502d5ee99b98769a06aac0e7c76cbff2f97905a238d940"
Sep 11 13:22:37.561806 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:37.561766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qwfrl" event={"ID":"45aae79c-25ad-41db-9623-c5a41c3f3620","Type":"ContainerStarted","Data":"4a84c4f7d34147855937e3d18279148b474cd88ed69b51ce932f52ca9a97b7a1"}
Sep 11 13:22:41.272231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:41.272147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:41.275982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:41.275962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6788766cc4-v8vxf"
Sep 11 13:22:47.480647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:47.480613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:47.591038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:47.591007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:22:58.444082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:22:58.444046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:06.875413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:06.875371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:06.891271 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:06.891244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:07.701546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:07.701494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:16.733172 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:16.733136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:16.830390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:16.830358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:17.873188 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873148    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:17.873686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873533    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="alertmanager" containerID="cri-o://e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3" gracePeriod=120
Sep 11 13:23:17.873686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873573    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-metric" containerID="cri-o://00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34" gracePeriod=120
Sep 11 13:23:17.873686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873598    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-web" containerID="cri-o://145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82" gracePeriod=120
Sep 11 13:23:17.873686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873637    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="prom-label-proxy" containerID="cri-o://be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656" gracePeriod=120
Sep 11 13:23:17.873886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873669    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy" containerID="cri-o://fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63" gracePeriod=120
Sep 11 13:23:17.873886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:17.873635    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="config-reloader" containerID="cri-o://b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e" gracePeriod=120
Sep 11 13:23:18.730871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730838    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656" exitCode=0
Sep 11 13:23:18.730871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730860    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63" exitCode=0
Sep 11 13:23:18.730871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730866    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e" exitCode=0
Sep 11 13:23:18.730871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730871    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3" exitCode=0
Sep 11 13:23:18.731123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"}
Sep 11 13:23:18.731123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.730975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"}
Sep 11 13:23:18.731123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.731004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"}
Sep 11 13:23:18.731123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:18.731027    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"}
Sep 11 13:23:19.116138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.116115    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:19.134245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lfsc\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134374    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134552    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134594    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134633    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:19.134664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.134856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.134789    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config\") pod \"438ded42-4e85-4fcb-826c-30c498551a31\" (UID: \"438ded42-4e85-4fcb-826c-30c498551a31\") "
Sep 11 13:23:19.135076 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.135057    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-main-db\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.135132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.135083    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:19.135728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.135687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:19.137305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.137270    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:19.137982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.137949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out" (OuterVolumeSpecName: "config-out") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:19.137982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.137959    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.137982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.137952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc" (OuterVolumeSpecName: "kube-api-access-5lfsc") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "kube-api-access-5lfsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:19.138562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.138536    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.138562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.138554    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume" (OuterVolumeSpecName: "config-volume") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.138708 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.138688    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.139082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.139065    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.141725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.141700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.149062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.149038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config" (OuterVolumeSpecName: "web-config") pod "438ded42-4e85-4fcb-826c-30c498551a31" (UID: "438ded42-4e85-4fcb-826c-30c498551a31"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235439    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235471    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235485    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-cluster-tls-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235521    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-main-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235536    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-web-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235550    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235562    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lfsc\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-kube-api-access-5lfsc\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235573    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/438ded42-4e85-4fcb-826c-30c498551a31-metrics-client-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235585    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-config-volume\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235594    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/438ded42-4e85-4fcb-826c-30c498551a31-tls-assets\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235604    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/438ded42-4e85-4fcb-826c-30c498551a31-config-out\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.235849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.235615    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/438ded42-4e85-4fcb-826c-30c498551a31-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:19.737701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737669    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34" exitCode=0
Sep 11 13:23:19.737701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737692    2582 generic.go:356] "Generic (PLEG): container finished" podID="438ded42-4e85-4fcb-826c-30c498551a31" containerID="145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82" exitCode=0
Sep 11 13:23:19.737899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"}
Sep 11 13:23:19.737899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737744    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:19.737899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"}
Sep 11 13:23:19.737899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"438ded42-4e85-4fcb-826c-30c498551a31","Type":"ContainerDied","Data":"3bf46043dd8dcd06740859fa45c04bacfca2eef3fe4b12a0782b7924e22b3a13"}
Sep 11 13:23:19.737899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.737845    2582 scope.go:117] "RemoveContainer" containerID="be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"
Sep 11 13:23:19.745706 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.745620    2582 scope.go:117] "RemoveContainer" containerID="00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"
Sep 11 13:23:19.752855 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.752835    2582 scope.go:117] "RemoveContainer" containerID="fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"
Sep 11 13:23:19.759149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.759132    2582 scope.go:117] "RemoveContainer" containerID="145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"
Sep 11 13:23:19.765338 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.765322    2582 scope.go:117] "RemoveContainer" containerID="b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"
Sep 11 13:23:19.771586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.771572    2582 scope.go:117] "RemoveContainer" containerID="e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"
Sep 11 13:23:19.778006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.777990    2582 scope.go:117] "RemoveContainer" containerID="e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"
Sep 11 13:23:19.784714 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.784697    2582 scope.go:117] "RemoveContainer" containerID="be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"
Sep 11 13:23:19.784985 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.784966    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656\": container with ID starting with be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656 not found: ID does not exist" containerID="be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"
Sep 11 13:23:19.785042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.784993    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"} err="failed to get container status \"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656\": rpc error: code = NotFound desc = could not find container \"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656\": container with ID starting with be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656 not found: ID does not exist"
Sep 11 13:23:19.785042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785024    2582 scope.go:117] "RemoveContainer" containerID="00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"
Sep 11 13:23:19.785248 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.785234    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34\": container with ID starting with 00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34 not found: ID does not exist" containerID="00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"
Sep 11 13:23:19.785289 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785252    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"} err="failed to get container status \"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34\": rpc error: code = NotFound desc = could not find container \"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34\": container with ID starting with 00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34 not found: ID does not exist"
Sep 11 13:23:19.785289 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785265    2582 scope.go:117] "RemoveContainer" containerID="fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"
Sep 11 13:23:19.785493 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.785475    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63\": container with ID starting with fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63 not found: ID does not exist" containerID="fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"
Sep 11 13:23:19.785493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785514    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"} err="failed to get container status \"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63\": rpc error: code = NotFound desc = could not find container \"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63\": container with ID starting with fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63 not found: ID does not exist"
Sep 11 13:23:19.785493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785532    2582 scope.go:117] "RemoveContainer" containerID="145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"
Sep 11 13:23:19.785756 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.785741    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82\": container with ID starting with 145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82 not found: ID does not exist" containerID="145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"
Sep 11 13:23:19.785791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785759    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"} err="failed to get container status \"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82\": rpc error: code = NotFound desc = could not find container \"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82\": container with ID starting with 145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82 not found: ID does not exist"
Sep 11 13:23:19.785791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.785771    2582 scope.go:117] "RemoveContainer" containerID="b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"
Sep 11 13:23:19.786001 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.785986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e\": container with ID starting with b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e not found: ID does not exist" containerID="b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"
Sep 11 13:23:19.786044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786003    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"} err="failed to get container status \"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e\": rpc error: code = NotFound desc = could not find container \"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e\": container with ID starting with b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e not found: ID does not exist"
Sep 11 13:23:19.786044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786019    2582 scope.go:117] "RemoveContainer" containerID="e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"
Sep 11 13:23:19.786225 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.786211    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3\": container with ID starting with e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3 not found: ID does not exist" containerID="e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"
Sep 11 13:23:19.786265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786227    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"} err="failed to get container status \"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3\": rpc error: code = NotFound desc = could not find container \"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3\": container with ID starting with e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3 not found: ID does not exist"
Sep 11 13:23:19.786265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786238    2582 scope.go:117] "RemoveContainer" containerID="e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"
Sep 11 13:23:19.786454 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:19.786436    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e\": container with ID starting with e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e not found: ID does not exist" containerID="e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"
Sep 11 13:23:19.786537 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786461    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"} err="failed to get container status \"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e\": rpc error: code = NotFound desc = could not find container \"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e\": container with ID starting with e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e not found: ID does not exist"
Sep 11 13:23:19.786537 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786482    2582 scope.go:117] "RemoveContainer" containerID="be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"
Sep 11 13:23:19.786788 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786770    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656"} err="failed to get container status \"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656\": rpc error: code = NotFound desc = could not find container \"be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656\": container with ID starting with be28d1cf5777a1f8842f5fed2f1f8e3e000221454f3de14d81b0aee8626aa656 not found: ID does not exist"
Sep 11 13:23:19.786855 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.786790    2582 scope.go:117] "RemoveContainer" containerID="00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"
Sep 11 13:23:19.787025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34"} err="failed to get container status \"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34\": rpc error: code = NotFound desc = could not find container \"00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34\": container with ID starting with 00237347735ced1e1bc45f9baf95be9e397705f6a489237df74dda0db9f4fa34 not found: ID does not exist"
Sep 11 13:23:19.787097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787026    2582 scope.go:117] "RemoveContainer" containerID="fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"
Sep 11 13:23:19.787276 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787257    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63"} err="failed to get container status \"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63\": rpc error: code = NotFound desc = could not find container \"fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63\": container with ID starting with fc18d77393040eaaa740f343fdc517cc7d73f218d8ec437b44692046fa185a63 not found: ID does not exist"
Sep 11 13:23:19.787318 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787277    2582 scope.go:117] "RemoveContainer" containerID="145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"
Sep 11 13:23:19.787538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787488    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82"} err="failed to get container status \"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82\": rpc error: code = NotFound desc = could not find container \"145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82\": container with ID starting with 145c36ca8a802ca3eac0fbd98b4e9ab77d408579ad9de01f99367707f11cab82 not found: ID does not exist"
Sep 11 13:23:19.787587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787539    2582 scope.go:117] "RemoveContainer" containerID="b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"
Sep 11 13:23:19.787776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787761    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e"} err="failed to get container status \"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e\": rpc error: code = NotFound desc = could not find container \"b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e\": container with ID starting with b2a2370e7eb07d3c5ca6cd81cebae48933ac6cdb6738f563429eeb69a349936e not found: ID does not exist"
Sep 11 13:23:19.787776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787775    2582 scope.go:117] "RemoveContainer" containerID="e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"
Sep 11 13:23:19.788006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.787985    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3"} err="failed to get container status \"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3\": rpc error: code = NotFound desc = could not find container \"e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3\": container with ID starting with e271734b2be9a7f361928a01db62579152aafab3fc15484071569c4a79df5af3 not found: ID does not exist"
Sep 11 13:23:19.788006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.788005    2582 scope.go:117] "RemoveContainer" containerID="e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"
Sep 11 13:23:19.788227 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:19.788203    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e"} err="failed to get container status \"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e\": rpc error: code = NotFound desc = could not find container \"e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e\": container with ID starting with e9c6babe56d1e8e0288433ada22c42926e575a78b5ce581b1fc744db75b6662e not found: ID does not exist"
Sep 11 13:23:21.089067 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.089002    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:21.090958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.090927    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:21.328387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328356    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:21.328660 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328646    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-web"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328661    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-web"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328669    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="config-reloader"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328675    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="config-reloader"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328681    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="prom-label-proxy"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328687    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="prom-label-proxy"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328699    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="alertmanager"
Sep 11 13:23:21.328707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328704    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="alertmanager"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328711    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="init-config-reloader"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328717    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="init-config-reloader"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328723    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-metric"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328728    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-metric"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328738    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328744    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328797    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="alertmanager"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328805    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="config-reloader"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328810    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-web"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328816    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy-metric"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328823    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="kube-rbac-proxy"
Sep 11 13:23:21.328982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.328829    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="438ded42-4e85-4fcb-826c-30c498551a31" containerName="prom-label-proxy"
Sep 11 13:23:21.332044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.332022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.335074 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.335054    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 13:23:21.335410 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.335382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 13:23:21.337990 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.337972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 13:23:21.338117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338034    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 13:23:21.338117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 13:23:21.338117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 13:23:21.338282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338145    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4fcc5\""
Sep 11 13:23:21.338379 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 13:23:21.338444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.338382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 13:23:21.348604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.348579    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 13:23:21.350820 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.350801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bth2f\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-kube-api-access-bth2f\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.350932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.350849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-web-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.350932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.350912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.350937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-out\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.350966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-volume\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.351434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.351335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.353546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.353524    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:21.451805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bth2f\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-kube-api-access-bth2f\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-web-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.451960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-out\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.451985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.452017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.452044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.452080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.452116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-volume\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.452682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.452662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.453526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.453487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.453687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.453662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9841c4e0-b0b2-41b8-9d99-247cb0748880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.455207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.455154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-out\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.455381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.455356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.455585 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.455562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.455935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.455840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-config-volume\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.456004 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.455965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.456203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.456180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.456203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.456196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-web-config\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.456306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.456289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.456595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.456576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9841c4e0-b0b2-41b8-9d99-247cb0748880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.460150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.460129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bth2f\" (UniqueName: \"kubernetes.io/projected/9841c4e0-b0b2-41b8-9d99-247cb0748880-kube-api-access-bth2f\") pod \"alertmanager-main-0\" (UID: \"9841c4e0-b0b2-41b8-9d99-247cb0748880\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:21.643253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:21.643187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 13:23:22.007782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.007664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 13:23:22.010524 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:23:22.010475    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9841c4e0_b0b2_41b8_9d99_247cb0748880.slice/crio-d13e33684b9cd6b1b1a2e1c0e2ef182b2a4cb9e6680bf1eb0f665722084a4cfe WatchSource:0}: Error finding container d13e33684b9cd6b1b1a2e1c0e2ef182b2a4cb9e6680bf1eb0f665722084a4cfe: Status 404 returned error can't find the container with id d13e33684b9cd6b1b1a2e1c0e2ef182b2a4cb9e6680bf1eb0f665722084a4cfe
Sep 11 13:23:22.753440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.753406    2582 generic.go:356] "Generic (PLEG): container finished" podID="9841c4e0-b0b2-41b8-9d99-247cb0748880" containerID="5e0fe1a95da9eb9ede8c51263b596a3fb534915213cbf004f03eb6a72a22590c" exitCode=0
Sep 11 13:23:22.753856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.753491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerDied","Data":"5e0fe1a95da9eb9ede8c51263b596a3fb534915213cbf004f03eb6a72a22590c"}
Sep 11 13:23:22.753856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.753580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"d13e33684b9cd6b1b1a2e1c0e2ef182b2a4cb9e6680bf1eb0f665722084a4cfe"}
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.762670    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.762993    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="prometheus" containerID="cri-o://a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2" gracePeriod=600
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.763163    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af" gracePeriod=600
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.763200    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="thanos-sidecar" containerID="cri-o://20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c" gracePeriod=600
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.763248    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="config-reloader" containerID="cri-o://424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52" gracePeriod=600
Sep 11 13:23:22.763350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.763319    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy" containerID="cri-o://53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df" gracePeriod=600
Sep 11 13:23:22.763774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.763324    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-web" containerID="cri-o://270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48" gracePeriod=600
Sep 11 13:23:22.852886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:22.852856    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="438ded42-4e85-4fcb-826c-30c498551a31" path="/var/lib/kubelet/pods/438ded42-4e85-4fcb-826c-30c498551a31/volumes"
Sep 11 13:23:23.046060 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.045884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.068755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.068650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.068755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.068703    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.068755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.068732    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069024 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.068997    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.069138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069118    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069252 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069225    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069252 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.069354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069278    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qjl2\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069523    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069594    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069619    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069655    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.069716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.070011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.069739    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") pod \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\" (UID: \"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4\") "
Sep 11 13:23:23.070061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.070011    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.070061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.070031    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.071137 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.070464    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.071137 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.070633    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.071350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.071309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.071640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.071607    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.072983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.072082    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:23.073339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.073200    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:23:23.073339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.073270    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.073339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.073317    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config" (OuterVolumeSpecName: "config") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.074441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.074409    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.075193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.075157    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.075423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.075378    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.076097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.076068    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out" (OuterVolumeSpecName: "config-out") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:23.076456 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.076375    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2" (OuterVolumeSpecName: "kube-api-access-2qjl2") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "kube-api-access-2qjl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:23.077196 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.077168    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.077327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.077289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.079018 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.078985    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:23.079873 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.079781    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.093011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.092973    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config" (OuterVolumeSpecName: "web-config") pod "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" (UID: "95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:23.170665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170644    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qjl2\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-kube-api-access-2qjl2\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170664    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config-out\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170676    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170686    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170694    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-kube-rbac-proxy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170703    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-db\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170712    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170721    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-grpc-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170730    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170738    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170745    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170754    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170762    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-secret-metrics-client-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170770    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-configmap-metrics-client-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170778    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.170782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170787    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.171204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170795    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-tls-assets\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.171204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.170803    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4-web-config\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:23:23.761595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"df8fa24accfbaa10a13b1519cf46461448ff292535dc8ab9ce93a3edf2078de5"}
Sep 11 13:23:23.761989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"bccbec3422a53dd4849feedc6e9a3e5923d601939bd337287b55d5c64dd6c903"}
Sep 11 13:23:23.761989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"0a13e7593dd65759b0e12dbc44cf77d0247db95458ed946c6126e2c52450e5b1"}
Sep 11 13:23:23.761989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"15f6f83b99ffc9d1e53bf2778317beaa663c2489fb97dc5acf8599fe16cdeee0"}
Sep 11 13:23:23.761989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"b04532d60634152a31b6b091f6978782bfa44cb2760e8cdef148cb3802c86d2a"}
Sep 11 13:23:23.761989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.761761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9841c4e0-b0b2-41b8-9d99-247cb0748880","Type":"ContainerStarted","Data":"82a8e228a2685ead8bd89b6c1156ef3f6861cda4c6fcd13eca7fc8ab439918ae"}
Sep 11 13:23:23.764681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764656    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af" exitCode=0
Sep 11 13:23:23.764681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764677    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df" exitCode=0
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764685    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48" exitCode=0
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764692    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c" exitCode=0
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764699    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52" exitCode=0
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764706    2582 generic.go:356] "Generic (PLEG): container finished" podID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2" exitCode=0
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"}
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764748    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"}
Sep 11 13:23:23.764826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"}
Sep 11 13:23:23.765110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"}
Sep 11 13:23:23.765110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764865    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.765110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.764871    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"}
Sep 11 13:23:23.765110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.765093    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"}
Sep 11 13:23:23.765283 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.765160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4","Type":"ContainerDied","Data":"4f1e6568b019a6eebcf2922d881ef56f7d59955eeac2b669193b261adc08e33d"}
Sep 11 13:23:23.772627 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.772609    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.779791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.779773    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.786292 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.786277    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.792716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.792699    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.799838 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.799822    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.800700 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.800662    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7825008 podStartE2EDuration="2.800648656s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.147856ms" isStatefulPod=false podCreationTimestamp="2026-09-11 13:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:23:23.799364625 +0000 UTC m=+217.631799779" watchObservedRunningTime="2026-09-11 13:23:23.800648656 +0000 UTC m=+217.633083796"
Sep 11 13:23:23.806923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.806905    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.814606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.814579    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.814869 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.814848    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.814943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.814876    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.814943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.814892    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.815168 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.815153    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.815218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815171    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.815218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815184    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.815452 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.815429    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.815555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815461    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.815555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815482    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.815863 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.815846    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.815913 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815866    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.815913 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.815881    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.816166 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.816150    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.816219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816171    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.816219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816189    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.816435 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.816417    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.816481 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816440    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.816481 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816452    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.816712 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:23:23.816697    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.816755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816715    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.816755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816726    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.816956 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816941    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.817004 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.816956    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.817175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817161    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.817175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817175    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.817400 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817382    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.817444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817400    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.817711 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817692    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.817711 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817708    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.817955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817937    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.817955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.817956    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.818210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818188    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.818271 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818212    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.818526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818489    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.818579 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818529    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.818766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818748    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.818813 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.818767    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.819095 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819072    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.819181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819096    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.819530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819485    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.819530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819528    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.819794 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819773    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.819794 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819794    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.820010 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.819992    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.820010 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820010    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.820238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820220    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.820238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820236    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.820464 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820440    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.820576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820466    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.820949 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820862    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.820949 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.820882    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.821194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821170    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.821296 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821195    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.821580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821477    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.821580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821518    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.821796 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821776    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.821878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.821797    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.822084 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822058    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.822168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822086    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.822371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822353    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.822371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822370    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.822670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822652    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.822741 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822670    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.822815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822792    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:23.822940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822907    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.823000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.822942    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.823202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823182    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.823285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823203    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.823528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823478    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.823528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823526    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.823795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823777    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.823866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.823796    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.824061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824046    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.824129 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824062    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.824302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824264    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.824358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824302    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.824621 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824592    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.824621 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824619    2582 scope.go:117] "RemoveContainer" containerID="0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"
Sep 11 13:23:23.824943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824921    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af"} err="failed to get container status \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": rpc error: code = NotFound desc = could not find container \"0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af\": container with ID starting with 0e84dadf262f4bf3fc6fd1697d3cc0dc5c947db8cc76b3883cda360a0ad131af not found: ID does not exist"
Sep 11 13:23:23.825013 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.824946    2582 scope.go:117] "RemoveContainer" containerID="53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"
Sep 11 13:23:23.825235 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825198    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df"} err="failed to get container status \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": rpc error: code = NotFound desc = could not find container \"53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df\": container with ID starting with 53a583a8f9674db47fe0f57d1f68751397d0acd5eb9789c097250177e119f9df not found: ID does not exist"
Sep 11 13:23:23.825327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825236    2582 scope.go:117] "RemoveContainer" containerID="270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"
Sep 11 13:23:23.825559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825539    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48"} err="failed to get container status \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": rpc error: code = NotFound desc = could not find container \"270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48\": container with ID starting with 270daad7d79e3ddd981db1a9f977af37f8b8acbf22680f255f8f61bb94ed2a48 not found: ID does not exist"
Sep 11 13:23:23.825632 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825561    2582 scope.go:117] "RemoveContainer" containerID="20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"
Sep 11 13:23:23.825856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825830    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c"} err="failed to get container status \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": rpc error: code = NotFound desc = could not find container \"20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c\": container with ID starting with 20153a1f8ee917afe11016cbcf8bf394f2c2e2284da379122ae4276774c60e7c not found: ID does not exist"
Sep 11 13:23:23.825944 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.825856    2582 scope.go:117] "RemoveContainer" containerID="424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"
Sep 11 13:23:23.826136 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.826114    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52"} err="failed to get container status \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": rpc error: code = NotFound desc = could not find container \"424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52\": container with ID starting with 424a5ceac560c4f498ee991bcf6a1364e4c5eaa9d576b30e2767362e9dd3aa52 not found: ID does not exist"
Sep 11 13:23:23.826208 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.826138    2582 scope.go:117] "RemoveContainer" containerID="a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"
Sep 11 13:23:23.826419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.826402    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2"} err="failed to get container status \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": rpc error: code = NotFound desc = could not find container \"a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2\": container with ID starting with a801da62f7679a21f0a8799a9e83ca22ea0fb6d2f9e2b0179554cf4e0b106fc2 not found: ID does not exist"
Sep 11 13:23:23.826496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.826420    2582 scope.go:117] "RemoveContainer" containerID="2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"
Sep 11 13:23:23.826695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.826673    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb"} err="failed to get container status \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": rpc error: code = NotFound desc = could not find container \"2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb\": container with ID starting with 2048c454d4b47b2185bdfde83d48df1ad002f7655869d67002d3f10833914fdb not found: ID does not exist"
Sep 11 13:23:23.830376 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.830357    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:23.870491 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870464    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:23.870900 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870881    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="prometheus"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="prometheus"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870933    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="config-reloader"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870939    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="config-reloader"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870948    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-web"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870953    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-web"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870962    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-thanos"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870967    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-thanos"
Sep 11 13:23:23.870976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870978    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="init-config-reloader"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.870986    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="init-config-reloader"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871000    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871005    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871013    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="thanos-sidecar"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871018    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="thanos-sidecar"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871071    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871080    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="prometheus"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871089    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-web"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871095    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="config-reloader"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871101    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="thanos-sidecar"
Sep 11 13:23:23.871195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.871106    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" containerName="kube-rbac-proxy-thanos"
Sep 11 13:23:23.876175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.876158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.887295 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.887276    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 13:23:23.888315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 13:23:23.888396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 13:23:23.888396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 13:23:23.888625 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888605    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 13:23:23.888689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888637    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 13:23:23.888689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 13:23:23.888689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 13:23:23.888689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.888660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 13:23:23.893221 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.893202    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1sjqa4d8h3ob9\""
Sep 11 13:23:23.893221 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.893214    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 13:23:23.893347 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.893203    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 13:23:23.893347 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.893248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rgv96\""
Sep 11 13:23:23.893471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.893455    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 13:23:23.896349 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.896333    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 13:23:23.898123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.898107    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 13:23:23.905269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.905246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:23.977588 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config-out\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-web-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977898 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977898 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxt9\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-kube-api-access-jnxt9\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977898 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.977981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.978128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.977985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.978128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.978003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.978128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.978028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:23.978128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:23.978067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078575 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config-out\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.078704 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-web-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxt9\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-kube-api-access-jnxt9\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.078981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.079824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.079613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.080530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.080484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.080635 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.080595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.082859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.082835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.082982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.082992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-web-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.083961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.083799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/017711e3-477b-4b0e-8e2c-3a3b65d2090f-config-out\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.084169 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.084146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.084267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.084251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/017711e3-477b-4b0e-8e2c-3a3b65d2090f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.085479 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.085461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/017711e3-477b-4b0e-8e2c-3a3b65d2090f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.088996 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.088974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxt9\" (UniqueName: \"kubernetes.io/projected/017711e3-477b-4b0e-8e2c-3a3b65d2090f-kube-api-access-jnxt9\") pod \"prometheus-k8s-0\" (UID: \"017711e3-477b-4b0e-8e2c-3a3b65d2090f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.187364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.187338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:24.476162 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.476071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 13:23:24.479876 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:23:24.479851    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017711e3_477b_4b0e_8e2c_3a3b65d2090f.slice/crio-7e082b2ca1cc5d0302a491d898f5671ad6bbb542d48ef5cb617ed31292ba20f3 WatchSource:0}: Error finding container 7e082b2ca1cc5d0302a491d898f5671ad6bbb542d48ef5cb617ed31292ba20f3: Status 404 returned error can't find the container with id 7e082b2ca1cc5d0302a491d898f5671ad6bbb542d48ef5cb617ed31292ba20f3
Sep 11 13:23:24.771556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.771525    2582 generic.go:356] "Generic (PLEG): container finished" podID="017711e3-477b-4b0e-8e2c-3a3b65d2090f" containerID="c3720a9e240d3c3ad143a79f39515b15ab406ac285b329f500df33410ab09689" exitCode=0
Sep 11 13:23:24.771883 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.771609    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerDied","Data":"c3720a9e240d3c3ad143a79f39515b15ab406ac285b329f500df33410ab09689"}
Sep 11 13:23:24.771883 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.771697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"7e082b2ca1cc5d0302a491d898f5671ad6bbb542d48ef5cb617ed31292ba20f3"}
Sep 11 13:23:24.852647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:24.852622    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4" path="/var/lib/kubelet/pods/95fd7fc5-bc91-49e3-b77d-f04cbe6edfc4/volumes"
Sep 11 13:23:25.778341 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"930f57a67f5ae669792cc16c1ad8e0e3f9ab203f04b59c34f4e444d04a703d08"}
Sep 11 13:23:25.778712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"6ff9b67f91534021ad76528f7fa4e132c55015e2f0faba9090afdcbed9e22fe2"}
Sep 11 13:23:25.778712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"b841c732d5153d1a70e06693f044169d1fc9eaa59d3751e0f3d9867d7f38692e"}
Sep 11 13:23:25.778712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"720a528434822ebda047aff01a17842d9288549a8d38a8c8ce9911a8ee42a629"}
Sep 11 13:23:25.778712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778518    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"7244f523676f537678104e67085f2f2fa99c4f94628e65314b2aa3f7b5705513"}
Sep 11 13:23:25.778712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.778554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"017711e3-477b-4b0e-8e2c-3a3b65d2090f","Type":"ContainerStarted","Data":"ce957d0daed9255bb35de10d155845afad58db8659a6cfb35ebe7b536ed84d11"}
Sep 11 13:23:25.813891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:25.813840    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7935771689999997 podStartE2EDuration="2.813818742s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.241573ms" isStatefulPod=false podCreationTimestamp="2026-09-11 13:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:23:25.811460164 +0000 UTC m=+219.643895302" watchObservedRunningTime="2026-09-11 13:23:25.813818742 +0000 UTC m=+219.646253882"
Sep 11 13:23:26.582085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:26.582050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:26.667281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:26.667254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:28.622113 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:28.622078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:29.187859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:29.187833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:23:37.563922 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:37.563886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:37.666455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:37.666424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:23:37.738257 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:23:37.738232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:02.355536 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:02.355484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:02.458549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:02.458498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:24.187958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:24.187866    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:24:24.203600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:24.203570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:24:24.893444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:24.893409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:25.028838 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:25.028813    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 13:24:32.750009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:32.749978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:32.844668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:32.844639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:33.606476 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:33.606440    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:33.683220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:33.683191    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:44.724209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:44.724143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:44.834640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:44.834590    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:44.925468 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:44.925437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:45.026286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:45.026259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:45.125666 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:45.125637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:46.565715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:46.565687    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 13:24:49.902935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:49.902900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:24:50.011132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:24:50.011074    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:31.955786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:25:31.955742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:32.060473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:25:32.060445    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:37.835419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:25:37.835381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:37.928343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:25:37.928313    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:25:47.583789 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:25:47.583690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:25.566384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:25.566339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:26.958724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:26.958679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:29.380231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:29.380199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:29.480784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:29.480755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:30.568369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:30.568334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:30.692419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:30.692385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:31.515154 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:31.515121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:31.616801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:31.616769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:33.675344 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:33.675315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:34.105633 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:34.105603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:36.167632 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:36.167595    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:36.267833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:36.267799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:39.569360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:39.569327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:39.672758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:39.672730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:41.682256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:41.682228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:47.577692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:47.577660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:47.678365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:47.678337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:54.196526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:54.196476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:26:54.299941 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:26:54.299905    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:03.100493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:03.100449    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:03.196899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:03.196854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:04.731540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:04.731491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:05.598860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:05.598823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:05.692859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:05.692826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:16.773486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:16.773379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:16.894132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:16.894097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:17.523041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:17.523002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:17.845824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:17.845793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:17.956795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:17.956758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.029764 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.029734    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"]
Sep 11 13:27:18.033226 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.033204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.035925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.035905    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 13:27:18.036056 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.036040    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 13:27:18.036105 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.036052    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 13:27:18.036148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.036121    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 13:27:18.037457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.037442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlvws\""
Sep 11 13:27:18.054937 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.054911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"]
Sep 11 13:27:18.126397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.126302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.126397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.126345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.126397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.126371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.126397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.126387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdwj\" (UniqueName: \"kubernetes.io/projected/3abf4212-026c-4438-9f73-9f13331a6bb2-kube-api-access-5wdwj\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.126668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.126446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.223179 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.223147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.227335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.227447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdwj\" (UniqueName: \"kubernetes.io/projected/3abf4212-026c-4438-9f73-9f13331a6bb2-kube-api-access-5wdwj\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.227447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.227447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.227613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.227800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.227779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.229682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.229660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3abf4212-026c-4438-9f73-9f13331a6bb2-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.229835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.229815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.229926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.229910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3abf4212-026c-4438-9f73-9f13331a6bb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.235385 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.235357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdwj\" (UniqueName: \"kubernetes.io/projected/3abf4212-026c-4438-9f73-9f13331a6bb2-kube-api-access-5wdwj\") pod \"opendatahub-operator-controller-manager-64959b9bbc-dt9qd\" (UID: \"3abf4212-026c-4438-9f73-9f13331a6bb2\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.321786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.321751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.343420 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.343395    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:18.405117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.404987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.484267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.484229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.592097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.592050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.619389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.619355    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"]
Sep 11 13:27:18.622442 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:27:18.622419    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abf4212_026c_4438_9f73_9f13331a6bb2.slice/crio-95bcc64d356346fc642bbb31e2196ba9cf57152a46ec169afe5b51b1975fd610 WatchSource:0}: Error finding container 95bcc64d356346fc642bbb31e2196ba9cf57152a46ec169afe5b51b1975fd610: Status 404 returned error can't find the container with id 95bcc64d356346fc642bbb31e2196ba9cf57152a46ec169afe5b51b1975fd610
Sep 11 13:27:18.624421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.624397    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:27:18.667924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.667855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:18.685587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:18.685560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd" event={"ID":"3abf4212-026c-4438-9f73-9f13331a6bb2","Type":"ContainerStarted","Data":"95bcc64d356346fc642bbb31e2196ba9cf57152a46ec169afe5b51b1975fd610"}
Sep 11 13:27:19.027263 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:19.027231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:19.176715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:19.176681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:21.702158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:21.702124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd" event={"ID":"3abf4212-026c-4438-9f73-9f13331a6bb2","Type":"ContainerStarted","Data":"fe213204b830eb5725900927269e976b270755e8e4466669705cf0339d42ffac"}
Sep 11 13:27:22.708169 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:22.708131    2582 generic.go:356] "Generic (PLEG): container finished" podID="3abf4212-026c-4438-9f73-9f13331a6bb2" containerID="fe213204b830eb5725900927269e976b270755e8e4466669705cf0339d42ffac" exitCode=0
Sep 11 13:27:22.708483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:22.708191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd" event={"ID":"3abf4212-026c-4438-9f73-9f13331a6bb2","Type":"ContainerDied","Data":"fe213204b830eb5725900927269e976b270755e8e4466669705cf0339d42ffac"}
Sep 11 13:27:23.714799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:23.714762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd" event={"ID":"3abf4212-026c-4438-9f73-9f13331a6bb2","Type":"ContainerStarted","Data":"a0b4c957f0557344a4fc8e86a2d3c5bfbb56f17300b8b236f40b80f9a0bd0157"}
Sep 11 13:27:23.715172 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:23.714882    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:23.741439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:23.741389    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd" podStartSLOduration=2.445319234 podStartE2EDuration="6.741371228s" totalImagesPullingTime="3.236287464s" totalInitContainerRuntime="1.05976453s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:23.739617874 +0000 UTC m=+457.572053014" watchObservedRunningTime="2026-09-11 13:27:23.741371228 +0000 UTC m=+457.573806367"
Sep 11 13:27:34.721693 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:34.721662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-dt9qd"
Sep 11 13:27:37.706692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.706660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:37.855369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.855325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:37.892833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.892800    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"]
Sep 11 13:27:37.904361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.904333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:37.906975 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.906953    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 13:27:37.907265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.907246    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 13:27:37.907884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.907861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"]
Sep 11 13:27:37.907959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.907920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 13:27:37.908602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.908584    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8swl5\""
Sep 11 13:27:37.912495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.912475    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 13:27:37.913198 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:37.913182    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:27:38.001469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.001379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/961f93a7-f2a5-4fdc-8259-732972f2294b-manager-config\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.001469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.001430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.001469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.001450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.001749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.001474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q755\" (UniqueName: \"kubernetes.io/projected/961f93a7-f2a5-4fdc-8259-732972f2294b-kube-api-access-5q755\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.072343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.072312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:38.102556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.102523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/961f93a7-f2a5-4fdc-8259-732972f2294b-manager-config\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.102701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.102599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.102701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.102625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.102701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.102651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q755\" (UniqueName: \"kubernetes.io/projected/961f93a7-f2a5-4fdc-8259-732972f2294b-kube-api-access-5q755\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.103316 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.103291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/961f93a7-f2a5-4fdc-8259-732972f2294b-manager-config\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.105157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.105127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.105317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.105298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/961f93a7-f2a5-4fdc-8259-732972f2294b-cert\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.119673 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.119648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q755\" (UniqueName: \"kubernetes.io/projected/961f93a7-f2a5-4fdc-8259-732972f2294b-kube-api-access-5q755\") pod \"lws-controller-manager-75ffb8c58-nrwd7\" (UID: \"961f93a7-f2a5-4fdc-8259-732972f2294b\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.215051 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.215020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:38.303288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.303258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:38.492436 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.492413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"]
Sep 11 13:27:38.494852 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:27:38.494820    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961f93a7_f2a5_4fdc_8259_732972f2294b.slice/crio-19bb9ea7b25ca621b15f5cb19a407e2e0f1fe1f141bea2b04d59caad1c906680 WatchSource:0}: Error finding container 19bb9ea7b25ca621b15f5cb19a407e2e0f1fe1f141bea2b04d59caad1c906680: Status 404 returned error can't find the container with id 19bb9ea7b25ca621b15f5cb19a407e2e0f1fe1f141bea2b04d59caad1c906680
Sep 11 13:27:38.779233 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:38.779199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7" event={"ID":"961f93a7-f2a5-4fdc-8259-732972f2294b","Type":"ContainerStarted","Data":"19bb9ea7b25ca621b15f5cb19a407e2e0f1fe1f141bea2b04d59caad1c906680"}
Sep 11 13:27:39.932445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:39.932407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:40.032752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:40.032724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:41.488302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:41.488195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:43.803764 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:43.803721    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7" event={"ID":"961f93a7-f2a5-4fdc-8259-732972f2294b","Type":"ContainerStarted","Data":"d926e69b67633c9e20738a43c92ce14f742b5a271672349007f85283a57e85a5"}
Sep 11 13:27:43.804216 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:43.803914    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:43.821481 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:43.821436    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7" podStartSLOduration=2.441610149 podStartE2EDuration="6.821418032s" totalImagesPullingTime="4.379807883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:43.820779645 +0000 UTC m=+477.653214783" watchObservedRunningTime="2026-09-11 13:27:43.821418032 +0000 UTC m=+477.653853168"
Sep 11 13:27:44.923556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:44.923516    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:44.990995 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:44.990965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:45.183856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.183784    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:45.186246 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.186225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.189623 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.189602    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:27:45.189738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.189605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hzr7m\""
Sep 11 13:27:45.198394 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.198372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:45.221785 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.221755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:45.269009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.268981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kh52\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.269419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.269324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.298826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.298799    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"]
Sep 11 13:27:45.301106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.301092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.315829 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.315807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"]
Sep 11 13:27:45.359390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.359343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:45.370586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.370715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.370715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.370715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.370825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrw8\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-kube-api-access-fvrw8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.370862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.370904 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.370904 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.370938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.371155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kh52\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371230    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371634 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.371698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.371684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.373071 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.373049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.373294 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.373277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.380360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.380343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.380539 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.380517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kh52\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.458012 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.457942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:45.472482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrw8\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-kube-api-access-fvrw8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.472921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.472955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.473069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.473107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.473555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.473535    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.475023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.475000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.475218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.475202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.481423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.481392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.481547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.481459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrw8\" (UniqueName: \"kubernetes.io/projected/533b3ae4-e172-4579-ac3e-f6ae87f36dd9-kube-api-access-fvrw8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj\" (UID: \"533b3ae4-e172-4579-ac3e-f6ae87f36dd9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.498396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.498375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:45.611174 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.611147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:45.772377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.772305    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:45.775069 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:27:45.775042    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f57fa3_3bb7_4e25_aba4_f97bb99afc8c.slice/crio-d4dfce47cd585fdd243fb31da5bb150371cd6af6d97471885072f2e7a2abe7c1 WatchSource:0}: Error finding container d4dfce47cd585fdd243fb31da5bb150371cd6af6d97471885072f2e7a2abe7c1: Status 404 returned error can't find the container with id d4dfce47cd585fdd243fb31da5bb150371cd6af6d97471885072f2e7a2abe7c1
Sep 11 13:27:45.813830 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.813799    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" event={"ID":"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c","Type":"ContainerStarted","Data":"d4dfce47cd585fdd243fb31da5bb150371cd6af6d97471885072f2e7a2abe7c1"}
Sep 11 13:27:45.883412 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:45.883372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"]
Sep 11 13:27:45.886210 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:27:45.886179    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533b3ae4_e172_4579_ac3e_f6ae87f36dd9.slice/crio-bd856d65561fdc88e9fa84aed185f113e9d5d4c43032a48903de1f1b6b749a07 WatchSource:0}: Error finding container bd856d65561fdc88e9fa84aed185f113e9d5d4c43032a48903de1f1b6b749a07: Status 404 returned error can't find the container with id bd856d65561fdc88e9fa84aed185f113e9d5d4c43032a48903de1f1b6b749a07
Sep 11 13:27:46.822982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:46.822943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj" event={"ID":"533b3ae4-e172-4579-ac3e-f6ae87f36dd9","Type":"ContainerStarted","Data":"bd856d65561fdc88e9fa84aed185f113e9d5d4c43032a48903de1f1b6b749a07"}
Sep 11 13:27:48.653755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.653711    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.654043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.653809    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.654043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.653846    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.659642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.659609    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.659732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.659691    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.659782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.659745    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:27:48.835945 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.835900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" event={"ID":"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c","Type":"ContainerStarted","Data":"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"}
Sep 11 13:27:48.837787 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.837754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj" event={"ID":"533b3ae4-e172-4579-ac3e-f6ae87f36dd9","Type":"ContainerStarted","Data":"9f3369b3acbec5dfbc14a943a72f504262f0937ea9ae6ee42b8dd2ab8aaa1132"}
Sep 11 13:27:48.865161 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.865125    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbpmf"]
Sep 11 13:27:48.865983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.865937    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" podStartSLOduration=0.983708482 podStartE2EDuration="3.865920337s" totalImagesPullingTime="2.882211855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:48.862815793 +0000 UTC m=+482.695250933" watchObservedRunningTime="2026-09-11 13:27:48.865920337 +0000 UTC m=+482.698355477"
Sep 11 13:27:48.868002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.867983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:48.872066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.872038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-n92tx\""
Sep 11 13:27:48.872472 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.872287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 13:27:48.883962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.883935    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbpmf"]
Sep 11 13:27:48.900168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.900053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:48.913103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.913026    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj" podStartSLOduration=1.147768991 podStartE2EDuration="3.91300657s" totalImagesPullingTime="2.765237579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:48.890591086 +0000 UTC m=+482.723026226" watchObservedRunningTime="2026-09-11 13:27:48.91300657 +0000 UTC m=+482.745441709"
Sep 11 13:27:48.976029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:48.975994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:49.006048 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.005912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0154221-3ef5-471f-9d9d-a8cc06b87811-cert\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.006231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.006067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28nf\" (UniqueName: \"kubernetes.io/projected/e0154221-3ef5-471f-9d9d-a8cc06b87811-kube-api-access-w28nf\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.077354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.077311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:49.107992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.107959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0154221-3ef5-471f-9d9d-a8cc06b87811-cert\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.108177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.108008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28nf\" (UniqueName: \"kubernetes.io/projected/e0154221-3ef5-471f-9d9d-a8cc06b87811-kube-api-access-w28nf\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.111117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.111049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0154221-3ef5-471f-9d9d-a8cc06b87811-cert\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.122212 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.122184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28nf\" (UniqueName: \"kubernetes.io/projected/e0154221-3ef5-471f-9d9d-a8cc06b87811-kube-api-access-w28nf\") pod \"odh-model-controller-7998c67dc4-fbpmf\" (UID: \"e0154221-3ef5-471f-9d9d-a8cc06b87811\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.180744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.180669    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:49.182111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.182074    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:49.472254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.472174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbpmf"]
Sep 11 13:27:49.475422 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:27:49.475398    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0154221_3ef5_471f_9d9d_a8cc06b87811.slice/crio-c054cb33029010b58ac4c32a25f84f579b136fda58c73a59f2b3a49383253479 WatchSource:0}: Error finding container c054cb33029010b58ac4c32a25f84f579b136fda58c73a59f2b3a49383253479: Status 404 returned error can't find the container with id c054cb33029010b58ac4c32a25f84f579b136fda58c73a59f2b3a49383253479
Sep 11 13:27:49.498826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.498800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:49.499866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.499834    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 11 13:27:49.499967 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.499896    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 11 13:27:49.586752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.586718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:49.611654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.611626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:49.617002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.616978    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:49.694127 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.694092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:49.842822 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.842790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf" event={"ID":"e0154221-3ef5-471f-9d9d-a8cc06b87811","Type":"ContainerStarted","Data":"c054cb33029010b58ac4c32a25f84f579b136fda58c73a59f2b3a49383253479"}
Sep 11 13:27:49.843233 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.843200    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:49.843978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.843958    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj"
Sep 11 13:27:49.963598 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:49.963565    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:50.499592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:50.499555    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 11 13:27:50.499783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:50.499620    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 11 13:27:51.499101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:51.499059    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 11 13:27:51.499586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:51.499133    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 11 13:27:51.853828 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:51.853784    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy" containerID="cri-o://4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d" gracePeriod=30
Sep 11 13:27:52.860224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:52.860186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf" event={"ID":"e0154221-3ef5-471f-9d9d-a8cc06b87811","Type":"ContainerStarted","Data":"9ddd036fb4aa8f6f6a09007acc5a8b884f92c7eed1776f2b87b360f01e81ada6"}
Sep 11 13:27:52.860604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:52.860304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:27:52.878201 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:52.878136    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf" podStartSLOduration=2.125174972 podStartE2EDuration="4.878114153s" totalImagesPullingTime="2.752939181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:52.877023859 +0000 UTC m=+486.709458989" watchObservedRunningTime="2026-09-11 13:27:52.878114153 +0000 UTC m=+486.710549292"
Sep 11 13:27:54.810320 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:54.810288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-nrwd7"
Sep 11 13:27:57.099602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.099578    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:57.188383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188296    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kh52\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188384    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188422    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188445    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188573    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188598    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188621    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs\") pod \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\" (UID: \"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c\") "
Sep 11 13:27:57.188953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:57.188953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188868    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:57.188953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.188917    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:27:57.189106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.189033    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.189106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.189053    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.189106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.189060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:57.189106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.189067    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.189106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.189084    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:57.190771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.190740    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:27:57.190869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.190801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:27:57.191047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.191028    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:57.191113 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.191047    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52" (OuterVolumeSpecName: "kube-api-access-6kh52") pod "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" (UID: "29f57fa3-3bb7-4e25-aba4-f97bb99afc8c"). InnerVolumeSpecName "kube-api-access-6kh52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:27:57.289717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289679    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.289717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289710    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.289717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289722    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.289957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289733    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kh52\" (UniqueName: \"kubernetes.io/projected/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-kube-api-access-6kh52\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.289957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289745    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.289957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.289755    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:27:57.886056 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.886020    2582 generic.go:356] "Generic (PLEG): container finished" podID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerID="4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d" exitCode=0
Sep 11 13:27:57.886222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.886065    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"
Sep 11 13:27:57.886222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.886066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" event={"ID":"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c","Type":"ContainerDied","Data":"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"}
Sep 11 13:27:57.886222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.886177    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf" event={"ID":"29f57fa3-3bb7-4e25-aba4-f97bb99afc8c","Type":"ContainerDied","Data":"d4dfce47cd585fdd243fb31da5bb150371cd6af6d97471885072f2e7a2abe7c1"}
Sep 11 13:27:57.886222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.886203    2582 scope.go:117] "RemoveContainer" containerID="4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"
Sep 11 13:27:57.896401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.896380    2582 scope.go:117] "RemoveContainer" containerID="4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"
Sep 11 13:27:57.896751 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:27:57.896731    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d\": container with ID starting with 4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d not found: ID does not exist" containerID="4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"
Sep 11 13:27:57.896818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.896759    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d"} err="failed to get container status \"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d\": rpc error: code = NotFound desc = could not find container \"4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d\": container with ID starting with 4d9000fb38eade5a76b008c8af1319c87b72a3168d734e7adece712a215fa14d not found: ID does not exist"
Sep 11 13:27:57.929845 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.929819    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:57.958670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:57.958644    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc2nxzf"]
Sep 11 13:27:58.851661 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:58.851624    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" path="/var/lib/kubelet/pods/29f57fa3-3bb7-4e25-aba4-f97bb99afc8c/volumes"
Sep 11 13:27:59.669381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.669349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:59.764726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.764692    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"]
Sep 11 13:27:59.765043 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.765031    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy"
Sep 11 13:27:59.765092 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.765044    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy"
Sep 11 13:27:59.765132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.765110    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f57fa3-3bb7-4e25-aba4-f97bb99afc8c" containerName="istio-proxy"
Sep 11 13:27:59.767699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.767683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:27:59.771793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.771769    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-89ktk\""
Sep 11 13:27:59.775514 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.775488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 13:27:59.803759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.803735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"]
Sep 11 13:27:59.852266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.852226    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:27:59.913428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.913401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:27:59.913582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:27:59.913449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84hc\" (UniqueName: \"kubernetes.io/projected/987a710f-099f-49b2-974e-fc56da6bac79-kube-api-access-n84hc\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.014112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.014006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.014275 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.014188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n84hc\" (UniqueName: \"kubernetes.io/projected/987a710f-099f-49b2-974e-fc56da6bac79-kube-api-access-n84hc\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.014275 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:28:00.014191    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 13:28:00.014388 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:28:00.014323    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert podName:987a710f-099f-49b2-974e-fc56da6bac79 nodeName:}" failed. No retries permitted until 2026-09-11 13:28:00.514301269 +0000 UTC m=+494.346736398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert") pod "kserve-controller-manager-d6f4b65b8-8wnv6" (UID: "987a710f-099f-49b2-974e-fc56da6bac79") : secret "kserve-webhook-server-cert" not found
Sep 11 13:28:00.034969 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.034941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:00.046302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.046273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84hc\" (UniqueName: \"kubernetes.io/projected/987a710f-099f-49b2-974e-fc56da6bac79-kube-api-access-n84hc\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.519862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.519826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.522260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.522240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/987a710f-099f-49b2-974e-fc56da6bac79-cert\") pod \"kserve-controller-manager-d6f4b65b8-8wnv6\" (UID: \"987a710f-099f-49b2-974e-fc56da6bac79\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.619462 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.619410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:00.677297 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.677262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:00.997854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:00.997829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"]
Sep 11 13:28:00.999884 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:28:00.999858    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987a710f_099f_49b2_974e_fc56da6bac79.slice/crio-5697d54768b8a6c54c829d018af5a5b449d87c16374caea5716ccb67d8477146 WatchSource:0}: Error finding container 5697d54768b8a6c54c829d018af5a5b449d87c16374caea5716ccb67d8477146: Status 404 returned error can't find the container with id 5697d54768b8a6c54c829d018af5a5b449d87c16374caea5716ccb67d8477146
Sep 11 13:28:01.003547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:01.003496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:01.200705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:01.200661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:01.910669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:01.910622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6" event={"ID":"987a710f-099f-49b2-974e-fc56da6bac79","Type":"ContainerStarted","Data":"5697d54768b8a6c54c829d018af5a5b449d87c16374caea5716ccb67d8477146"}
Sep 11 13:28:03.866521 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:03.866470    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbpmf"
Sep 11 13:28:03.922696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:03.922605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6" event={"ID":"987a710f-099f-49b2-974e-fc56da6bac79","Type":"ContainerStarted","Data":"169071c7c30af655593d715a995d81b862faf44fa8c037a8a2db6dc64f92e6cc"}
Sep 11 13:28:03.922696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:03.922669    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:03.947065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:03.947012    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6" podStartSLOduration=2.307752909 podStartE2EDuration="4.946994802s" totalImagesPullingTime="2.639241893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:28:03.946260572 +0000 UTC m=+497.778695712" watchObservedRunningTime="2026-09-11 13:28:03.946994802 +0000 UTC m=+497.779429941"
Sep 11 13:28:34.932587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:34.932552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8wnv6"
Sep 11 13:28:50.154938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:50.154903    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:28:50.348342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:28:50.348312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:01.679492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:01.679460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:05.152378 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:05.152343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:05.923307 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:05.923272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:08.385209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.385173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5c2vq"]
Sep 11 13:29:08.388426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.388409    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:08.390832 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.390808    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 13:29:08.390939 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.390808    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 13:29:08.391582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.391565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-brdqx\""
Sep 11 13:29:08.402763 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.402742    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5c2vq"]
Sep 11 13:29:08.404303 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.404282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr75k\" (UniqueName: \"kubernetes.io/projected/4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2-kube-api-access-sr75k\") pod \"authorino-operator-76b478bd78-5c2vq\" (UID: \"4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2\") " pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:08.505096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.505055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr75k\" (UniqueName: \"kubernetes.io/projected/4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2-kube-api-access-sr75k\") pod \"authorino-operator-76b478bd78-5c2vq\" (UID: \"4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2\") " pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:08.546751 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.546711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr75k\" (UniqueName: \"kubernetes.io/projected/4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2-kube-api-access-sr75k\") pod \"authorino-operator-76b478bd78-5c2vq\" (UID: \"4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2\") " pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:08.636822 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.636735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:08.698816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.698789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:08.818287 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.818253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:08.980373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:08.980303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5c2vq"]
Sep 11 13:29:08.983949 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:29:08.983916    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b95734e_d668_4cd8_bb15_9c1f0ef8a1c2.slice/crio-dbc38bb715a9090bc5217713aab345078afda773628fd4691b35afcf478b9ca5 WatchSource:0}: Error finding container dbc38bb715a9090bc5217713aab345078afda773628fd4691b35afcf478b9ca5: Status 404 returned error can't find the container with id dbc38bb715a9090bc5217713aab345078afda773628fd4691b35afcf478b9ca5
Sep 11 13:29:09.218829 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:09.218796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq" event={"ID":"4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2","Type":"ContainerStarted","Data":"dbc38bb715a9090bc5217713aab345078afda773628fd4691b35afcf478b9ca5"}
Sep 11 13:29:09.317812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:09.317775    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:10.828535 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:10.828489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:11.231888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:11.231848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq" event={"ID":"4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2","Type":"ContainerStarted","Data":"fa191ca242d305d522174100e2152ade428a10cf210a2593cba865451ad9e908"}
Sep 11 13:29:11.232077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:11.231910    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:11.297582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:11.297526    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq" podStartSLOduration=1.213342282 podStartE2EDuration="3.297490881s" totalImagesPullingTime="2.084148599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:11.292415836 +0000 UTC m=+565.124850975" watchObservedRunningTime="2026-09-11 13:29:11.297490881 +0000 UTC m=+565.129926021"
Sep 11 13:29:11.653213 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:11.653184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:11.987688 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:11.987606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:12.360328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:12.360297    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:13.616958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:13.616928    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:13.821679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:13.821637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:15.254103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.254073    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"]
Sep 11 13:29:15.256730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.256713    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.258994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.258974    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m7xkw\""
Sep 11 13:29:15.285037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.285014    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"]
Sep 11 13:29:15.371639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.371615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.371748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.371656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj7ql\" (UniqueName: \"kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.472910 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.472880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj7ql\" (UniqueName: \"kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.473049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.472956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.473255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.473240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.483412 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.483388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj7ql\" (UniqueName: \"kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.567173 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.567145    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:15.735419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.735380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:15.852852 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.852793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"]
Sep 11 13:29:15.855039 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:29:15.855015    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37edde9e_d0d2_4164_b3e5_3cf176a2e998.slice/crio-38ae89c9c3130c5a19af9bef5eeb3882eceb710c5bc134c6282eaabd29c764b3 WatchSource:0}: Error finding container 38ae89c9c3130c5a19af9bef5eeb3882eceb710c5bc134c6282eaabd29c764b3: Status 404 returned error can't find the container with id 38ae89c9c3130c5a19af9bef5eeb3882eceb710c5bc134c6282eaabd29c764b3
Sep 11 13:29:15.859579 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:15.859556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:16.255571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:16.255472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs" event={"ID":"37edde9e-d0d2-4164-b3e5-3cf176a2e998","Type":"ContainerStarted","Data":"38ae89c9c3130c5a19af9bef5eeb3882eceb710c5bc134c6282eaabd29c764b3"}
Sep 11 13:29:18.741953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:18.741893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:18.842857 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:18.842824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:18.948329 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:18.948291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:19.036141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:19.036098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:20.280161 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:20.280123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs" event={"ID":"37edde9e-d0d2-4164-b3e5-3cf176a2e998","Type":"ContainerStarted","Data":"bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef"}
Sep 11 13:29:20.280662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:20.280209    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:20.311125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:20.311065    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs" podStartSLOduration=1.442734394 podStartE2EDuration="5.311044171s" totalImagesPullingTime="3.868309777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:20.310954022 +0000 UTC m=+574.143389187" watchObservedRunningTime="2026-09-11 13:29:20.311044171 +0000 UTC m=+574.143479303"
Sep 11 13:29:22.239804 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:22.239774    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-5c2vq"
Sep 11 13:29:22.668223 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:22.668182    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:22.852154 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:22.852112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:23.126455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:23.126420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:23.306518 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:23.306476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:27.160010 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:27.159974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:27.254639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:27.254603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:27.396490 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:27.396444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:31.286558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:31.286531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:33.906979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:33.906932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:34.366463 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.366432    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"]
Sep 11 13:29:34.366662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.366646    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" containerName="manager" containerID="cri-o://bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef" gracePeriod=2
Sep 11 13:29:34.398028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.398002    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"]
Sep 11 13:29:34.406651 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:29:34.406614    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37edde9e-d0d2-4164-b3e5-3cf176a2e998\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-8fshs\": pods \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:34.449440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.449409    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:34.449818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.449805    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" containerName="manager"
Sep 11 13:29:34.449870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.449819    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" containerName="manager"
Sep 11 13:29:34.449906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.449882    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" containerName="manager"
Sep 11 13:29:34.455902 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.455880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.481947 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.481915    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:34.540439 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:29:34.540402    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:34.544850 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.544813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.544991 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.544859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gprsj\" (UniqueName: \"kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.627101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.627035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:34.630045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.630023    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:34.632407 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:29:34.632383    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8fshs\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:34.645657 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.645636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.645760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.645671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gprsj\" (UniqueName: \"kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.646025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.646004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.671290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.671265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gprsj\" (UniqueName: \"kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-bkgnf\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.746144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.746103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume\") pod \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") "
Sep 11 13:29:34.746343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.746207    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj7ql\" (UniqueName: \"kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql\") pod \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\" (UID: \"37edde9e-d0d2-4164-b3e5-3cf176a2e998\") "
Sep 11 13:29:34.746664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.746642    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37edde9e-d0d2-4164-b3e5-3cf176a2e998" (UID: "37edde9e-d0d2-4164-b3e5-3cf176a2e998"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:29:34.748389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.748366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql" (OuterVolumeSpecName: "kube-api-access-mj7ql") pod "37edde9e-d0d2-4164-b3e5-3cf176a2e998" (UID: "37edde9e-d0d2-4164-b3e5-3cf176a2e998"). InnerVolumeSpecName "kube-api-access-mj7ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:29:34.766592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.766560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:34.846997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.846972    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37edde9e-d0d2-4164-b3e5-3cf176a2e998-extensions-socket-volume\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:29:34.846997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.846995    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj7ql\" (UniqueName: \"kubernetes.io/projected/37edde9e-d0d2-4164-b3e5-3cf176a2e998-kube-api-access-mj7ql\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:29:34.853269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:34.853243    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" path="/var/lib/kubelet/pods/37edde9e-d0d2-4164-b3e5-3cf176a2e998/volumes"
Sep 11 13:29:35.114979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.114947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:35.119417 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:29:35.119390    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c4016f_7215_4c0a_a3e0_f593e414814b.slice/crio-5b7cd20ecb50f7dcdccd50af5691f211c611ad6bce8025972ac9e7a8554e770d WatchSource:0}: Error finding container 5b7cd20ecb50f7dcdccd50af5691f211c611ad6bce8025972ac9e7a8554e770d: Status 404 returned error can't find the container with id 5b7cd20ecb50f7dcdccd50af5691f211c611ad6bce8025972ac9e7a8554e770d
Sep 11 13:29:35.361724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.361691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" event={"ID":"87c4016f-7215-4c0a-a3e0-f593e414814b","Type":"ContainerStarted","Data":"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"}
Sep 11 13:29:35.361968 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.361751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" event={"ID":"87c4016f-7215-4c0a-a3e0-f593e414814b","Type":"ContainerStarted","Data":"5b7cd20ecb50f7dcdccd50af5691f211c611ad6bce8025972ac9e7a8554e770d"}
Sep 11 13:29:35.361968 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.361796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:35.363073 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.363047    2582 generic.go:356] "Generic (PLEG): container finished" podID="37edde9e-d0d2-4164-b3e5-3cf176a2e998" containerID="bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef" exitCode=0
Sep 11 13:29:35.363195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.363086    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8fshs"
Sep 11 13:29:35.363195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.363129    2582 scope.go:117] "RemoveContainer" containerID="bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef"
Sep 11 13:29:35.378463 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.378236    2582 scope.go:117] "RemoveContainer" containerID="bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef"
Sep 11 13:29:35.378595 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:29:35.378578    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef\": container with ID starting with bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef not found: ID does not exist" containerID="bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef"
Sep 11 13:29:35.378644 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.378605    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef"} err="failed to get container status \"bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef\": rpc error: code = NotFound desc = could not find container \"bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef\": container with ID starting with bb0241c050feedaf2deb38a43899c2542b5b931f4ef562516bdcb565ce475bef not found: ID does not exist"
Sep 11 13:29:35.391382 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:35.391327    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" podStartSLOduration=1.39130699 podStartE2EDuration="1.39130699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:35.387681245 +0000 UTC m=+589.220116385" watchObservedRunningTime="2026-09-11 13:29:35.39130699 +0000 UTC m=+589.223742129"
Sep 11 13:29:37.866645 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:37.866605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:38.027338 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:38.027305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:38.625988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:38.625957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:38.730117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:38.730083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:38.835549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:38.835518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:42.552654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:42.552620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:42.791078 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:42.791042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:46.370549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:46.370516    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:47.562090 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:47.562056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:47.713583 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:47.713544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:47.834087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:47.834005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:47.947639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:47.947607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:53.274493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.274439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:53.379723 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.379686    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:53.379924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.379899    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" podUID="87c4016f-7215-4c0a-a3e0-f593e414814b" containerName="manager" containerID="cri-o://573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a" gracePeriod=10
Sep 11 13:29:53.431444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.431409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:29:53.632425 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.632398    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:53.699034 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.699003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gprsj\" (UniqueName: \"kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj\") pod \"87c4016f-7215-4c0a-a3e0-f593e414814b\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") "
Sep 11 13:29:53.699208 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.699076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume\") pod \"87c4016f-7215-4c0a-a3e0-f593e414814b\" (UID: \"87c4016f-7215-4c0a-a3e0-f593e414814b\") "
Sep 11 13:29:53.699475 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.699449    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87c4016f-7215-4c0a-a3e0-f593e414814b" (UID: "87c4016f-7215-4c0a-a3e0-f593e414814b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:29:53.701099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.701074    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj" (OuterVolumeSpecName: "kube-api-access-gprsj") pod "87c4016f-7215-4c0a-a3e0-f593e414814b" (UID: "87c4016f-7215-4c0a-a3e0-f593e414814b"). InnerVolumeSpecName "kube-api-access-gprsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:29:53.799801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.799726    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c4016f-7215-4c0a-a3e0-f593e414814b-extensions-socket-volume\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:29:53.799801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:53.799753    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gprsj\" (UniqueName: \"kubernetes.io/projected/87c4016f-7215-4c0a-a3e0-f593e414814b-kube-api-access-gprsj\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:29:54.456152 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.456119    2582 generic.go:356] "Generic (PLEG): container finished" podID="87c4016f-7215-4c0a-a3e0-f593e414814b" containerID="573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a" exitCode=0
Sep 11 13:29:54.456590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.456172    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"
Sep 11 13:29:54.456590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.456203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" event={"ID":"87c4016f-7215-4c0a-a3e0-f593e414814b","Type":"ContainerDied","Data":"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"}
Sep 11 13:29:54.456590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.456261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf" event={"ID":"87c4016f-7215-4c0a-a3e0-f593e414814b","Type":"ContainerDied","Data":"5b7cd20ecb50f7dcdccd50af5691f211c611ad6bce8025972ac9e7a8554e770d"}
Sep 11 13:29:54.456590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.456283    2582 scope.go:117] "RemoveContainer" containerID="573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"
Sep 11 13:29:54.465141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.465123    2582 scope.go:117] "RemoveContainer" containerID="573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"
Sep 11 13:29:54.465404 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:29:54.465385    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a\": container with ID starting with 573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a not found: ID does not exist" containerID="573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"
Sep 11 13:29:54.465466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.465418    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a"} err="failed to get container status \"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a\": rpc error: code = NotFound desc = could not find container \"573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a\": container with ID starting with 573ab77f74d14570c675fb669b587191fdb359a79b8499a4f67a858bd414c46a not found: ID does not exist"
Sep 11 13:29:54.487269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.487244    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:54.496248 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.496228    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-bkgnf"]
Sep 11 13:29:54.852620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:29:54.852588    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c4016f-7215-4c0a-a3e0-f593e414814b" path="/var/lib/kubelet/pods/87c4016f-7215-4c0a-a3e0-f593e414814b/volumes"
Sep 11 13:30:07.177110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:07.177071    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:07.273600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:07.273559    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:10.213092 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.213009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"]
Sep 11 13:30:10.213457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.213422    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c4016f-7215-4c0a-a3e0-f593e414814b" containerName="manager"
Sep 11 13:30:10.213457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.213435    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c4016f-7215-4c0a-a3e0-f593e414814b" containerName="manager"
Sep 11 13:30:10.213573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.213513    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c4016f-7215-4c0a-a3e0-f593e414814b" containerName="manager"
Sep 11 13:30:10.216379 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.216360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.224306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.224285    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f4g6j\""
Sep 11 13:30:10.239927 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.239897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"]
Sep 11 13:30:10.270293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.270260    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:10.344803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82pzc\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-kube-api-access-82pzc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.344976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.344976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.344976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.344976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.344976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.344960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.345219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.345055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56339ef8-4199-4434-b47b-e27f01c87a76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.345219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.345097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56339ef8-4199-4434-b47b-e27f01c87a76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.345219 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.345119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56339ef8-4199-4434-b47b-e27f01c87a76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56339ef8-4199-4434-b47b-e27f01c87a76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82pzc\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-kube-api-access-82pzc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.446915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.446919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447279 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.447236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.447334    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447412 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.447382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447478 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.447455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.447561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.447536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56339ef8-4199-4434-b47b-e27f01c87a76-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.449146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.449123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56339ef8-4199-4434-b47b-e27f01c87a76-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.449260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.449243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56339ef8-4199-4434-b47b-e27f01c87a76-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.460066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.460043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.462635 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.462619    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82pzc\" (UniqueName: \"kubernetes.io/projected/56339ef8-4199-4434-b47b-e27f01c87a76-kube-api-access-82pzc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wgtg9\" (UID: \"56339ef8-4199-4434-b47b-e27f01c87a76\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.526968 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.526920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:10.644252 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.644183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:10.818272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.818180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"]
Sep 11 13:30:10.822572 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:30:10.822543    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56339ef8_4199_4434_b47b_e27f01c87a76.slice/crio-10474f550d2eab30b7cf9fd918c64edbe925f3b36bc1235162b5cbdcfea4f9e1 WatchSource:0}: Error finding container 10474f550d2eab30b7cf9fd918c64edbe925f3b36bc1235162b5cbdcfea4f9e1: Status 404 returned error can't find the container with id 10474f550d2eab30b7cf9fd918c64edbe925f3b36bc1235162b5cbdcfea4f9e1
Sep 11 13:30:10.824574 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.824533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:30:10.824649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.824611    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:30:10.824649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:10.824641    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:30:11.538749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:11.538712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" event={"ID":"56339ef8-4199-4434-b47b-e27f01c87a76","Type":"ContainerStarted","Data":"d9627ab8c3f8c247e3ff178a566dcc432543394f7e19ba990929ee234bfb3578"}
Sep 11 13:30:11.539129 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:11.538770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" event={"ID":"56339ef8-4199-4434-b47b-e27f01c87a76","Type":"ContainerStarted","Data":"10474f550d2eab30b7cf9fd918c64edbe925f3b36bc1235162b5cbdcfea4f9e1"}
Sep 11 13:30:11.560921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:11.560874    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podStartSLOduration=1.560856742 podStartE2EDuration="1.560856742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:11.559035515 +0000 UTC m=+625.391470658" watchObservedRunningTime="2026-09-11 13:30:11.560856742 +0000 UTC m=+625.393291880"
Sep 11 13:30:12.527587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.527546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:12.532381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.532354    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:12.543383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.543363    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:12.544237 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.544219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:30:12.682349 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.682319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:12.692999 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.692968    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:12.695327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.695308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.698077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.698055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5b74\""
Sep 11 13:30:12.698192 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.698057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 13:30:12.706752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.706729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:12.767841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.767802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.768022 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.767858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsn2\" (UniqueName: \"kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.788668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.788593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:12.789792 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.789772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:12.868903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.868870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.869079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.868920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsn2\" (UniqueName: \"kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.869703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.869677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.879878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.879829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsn2\" (UniqueName: \"kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2\") pod \"limitador-limitador-8588749977-zbbhm\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") " pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:12.887355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:12.887330    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:13.006370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:13.006332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:13.283979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:13.283958    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:13.286600 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:30:13.286573    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50017e3b_b534_42b8_86ef_5c95e6426d55.slice/crio-e9d4ca95d0365a8a943c289d89f8ffe4fdaa97ee181ae91d17ec3c704cab98fa WatchSource:0}: Error finding container e9d4ca95d0365a8a943c289d89f8ffe4fdaa97ee181ae91d17ec3c704cab98fa: Status 404 returned error can't find the container with id e9d4ca95d0365a8a943c289d89f8ffe4fdaa97ee181ae91d17ec3c704cab98fa
Sep 11 13:30:13.549756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:13.549712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" event={"ID":"50017e3b-b534-42b8-86ef-5c95e6426d55","Type":"ContainerStarted","Data":"e9d4ca95d0365a8a943c289d89f8ffe4fdaa97ee181ae91d17ec3c704cab98fa"}
Sep 11 13:30:13.573572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:13.573538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:13.661887 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:13.661861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:15.560593 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:15.560558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" event={"ID":"50017e3b-b534-42b8-86ef-5c95e6426d55","Type":"ContainerStarted","Data":"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"}
Sep 11 13:30:15.560978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:15.560675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:15.582470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:15.582408    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" podStartSLOduration=1.8319480970000002 podStartE2EDuration="3.582389134s" totalImagesPullingTime="1.750441037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:15.580280316 +0000 UTC m=+629.412715454" watchObservedRunningTime="2026-09-11 13:30:15.582389134 +0000 UTC m=+629.414824273"
Sep 11 13:30:26.566825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:26.566793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:28.428514 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:28.428464    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:28.428893 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:28.428664    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" podUID="50017e3b-b534-42b8-86ef-5c95e6426d55" containerName="limitador" containerID="cri-o://2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852" gracePeriod=30
Sep 11 13:30:29.369207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.369183    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:29.522743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.522659    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klsn2\" (UniqueName: \"kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2\") pod \"50017e3b-b534-42b8-86ef-5c95e6426d55\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") "
Sep 11 13:30:29.522743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.522700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file\") pod \"50017e3b-b534-42b8-86ef-5c95e6426d55\" (UID: \"50017e3b-b534-42b8-86ef-5c95e6426d55\") "
Sep 11 13:30:29.523229 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.523134    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file" (OuterVolumeSpecName: "config-file") pod "50017e3b-b534-42b8-86ef-5c95e6426d55" (UID: "50017e3b-b534-42b8-86ef-5c95e6426d55"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:30:29.524758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.524735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2" (OuterVolumeSpecName: "kube-api-access-klsn2") pod "50017e3b-b534-42b8-86ef-5c95e6426d55" (UID: "50017e3b-b534-42b8-86ef-5c95e6426d55"). InnerVolumeSpecName "kube-api-access-klsn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:29.624358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.624327    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klsn2\" (UniqueName: \"kubernetes.io/projected/50017e3b-b534-42b8-86ef-5c95e6426d55-kube-api-access-klsn2\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:30:29.624358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.624354    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50017e3b-b534-42b8-86ef-5c95e6426d55-config-file\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:30:29.631390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.631364    2582 generic.go:356] "Generic (PLEG): container finished" podID="50017e3b-b534-42b8-86ef-5c95e6426d55" containerID="2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852" exitCode=0
Sep 11 13:30:29.631525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.631404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm"
Sep 11 13:30:29.631525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.631447    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" event={"ID":"50017e3b-b534-42b8-86ef-5c95e6426d55","Type":"ContainerDied","Data":"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"}
Sep 11 13:30:29.631525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.631492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zbbhm" event={"ID":"50017e3b-b534-42b8-86ef-5c95e6426d55","Type":"ContainerDied","Data":"e9d4ca95d0365a8a943c289d89f8ffe4fdaa97ee181ae91d17ec3c704cab98fa"}
Sep 11 13:30:29.631672 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.631528    2582 scope.go:117] "RemoveContainer" containerID="2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"
Sep 11 13:30:29.640647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.640629    2582 scope.go:117] "RemoveContainer" containerID="2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"
Sep 11 13:30:29.640932 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:30:29.640910    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852\": container with ID starting with 2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852 not found: ID does not exist" containerID="2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"
Sep 11 13:30:29.640980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.640940    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852"} err="failed to get container status \"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852\": rpc error: code = NotFound desc = could not find container \"2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852\": container with ID starting with 2e4b19cc5eff0d3620d9f0cfc49d035ecd402f580230d9a461864c1b4141f852 not found: ID does not exist"
Sep 11 13:30:29.653455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.653434    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:29.658123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:29.658101    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zbbhm"]
Sep 11 13:30:30.334365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:30.334334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:30.852204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:30.852175    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50017e3b-b534-42b8-86ef-5c95e6426d55" path="/var/lib/kubelet/pods/50017e3b-b534-42b8-86ef-5c95e6426d55/volumes"
Sep 11 13:30:34.330212 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:34.330178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:36.157320 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.157282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:36.219755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.219722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:36.804677 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.804648    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"]
Sep 11 13:30:36.805056 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.805036    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50017e3b-b534-42b8-86ef-5c95e6426d55" containerName="limitador"
Sep 11 13:30:36.805056 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.805053    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50017e3b-b534-42b8-86ef-5c95e6426d55" containerName="limitador"
Sep 11 13:30:36.805209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.805115    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50017e3b-b534-42b8-86ef-5c95e6426d55" containerName="limitador"
Sep 11 13:30:36.807877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.807861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:36.811433 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.811414    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 13:30:36.811563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.811415    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:30:36.811563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.811418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:30:36.811694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.811675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-swgh6\""
Sep 11 13:30:36.821529 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.821488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"]
Sep 11 13:30:36.834019 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.833956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:36.889611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.889586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-data\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:36.889729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.889691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f5q7\" (UniqueName: \"kubernetes.io/projected/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-kube-api-access-9f5q7\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:36.991160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.991125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f5q7\" (UniqueName: \"kubernetes.io/projected/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-kube-api-access-9f5q7\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:36.991339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.991169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-data\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:36.991602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:36.991583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-data\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:37.000038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:37.000014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f5q7\" (UniqueName: \"kubernetes.io/projected/1986e35f-c383-4ab7-bbf9-f12abc0ea1cb-kube-api-access-9f5q7\") pod \"postgres-69fb4594cf-q88lq\" (UID: \"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:37.117846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:37.117776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:37.390046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:37.390022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"]
Sep 11 13:30:37.392828 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:30:37.392804    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1986e35f_c383_4ab7_bbf9_f12abc0ea1cb.slice/crio-290367783b30abce08e43d7500e266c001f5a807884b37adcccbddd95e00a12f WatchSource:0}: Error finding container 290367783b30abce08e43d7500e266c001f5a807884b37adcccbddd95e00a12f: Status 404 returned error can't find the container with id 290367783b30abce08e43d7500e266c001f5a807884b37adcccbddd95e00a12f
Sep 11 13:30:37.669875 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:37.669798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq" event={"ID":"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb","Type":"ContainerStarted","Data":"290367783b30abce08e43d7500e266c001f5a807884b37adcccbddd95e00a12f"}
Sep 11 13:30:42.700847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:42.700815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq" event={"ID":"1986e35f-c383-4ab7-bbf9-f12abc0ea1cb","Type":"ContainerStarted","Data":"fa9d864381ec8f83188693444326bd92d044ac0833bbcbd1b65c35ccb8be2747"}
Sep 11 13:30:42.701412 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:42.700882    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:42.719157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:42.719079    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq" podStartSLOduration=1.646369304 podStartE2EDuration="6.719062416s" totalImagesPullingTime="5.072693112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:42.717990079 +0000 UTC m=+656.550425220" watchObservedRunningTime="2026-09-11 13:30:42.719062416 +0000 UTC m=+656.551497554"
Sep 11 13:30:48.735214 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:48.735177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q88lq"
Sep 11 13:30:49.125066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:49.125031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:50.957989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:50.957944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:56.637847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.637806    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:56.729340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.729286    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:56.791470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.791434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:56.854390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.854361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:56.861461 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.861436    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:30:56.866784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.866769    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:56.870916 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.870897    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 13:30:56.871028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.870948    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 13:30:56.871028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.871015    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4q2dl\""
Sep 11 13:30:56.871774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.871756    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 13:30:56.874979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.874959    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:30:56.983557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.983484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:56.983682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.983575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9826\" (UniqueName: \"kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:56.983682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:56.983603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.084978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.084939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.085145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.084985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9826\" (UniqueName: \"kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.085145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.085013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.085145 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:30:57.085088    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 13:30:57.085282 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:30:57.085162    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert podName:7f1744fd-d112-4b95-8387-e68fdac79d07 nodeName:}" failed. No retries permitted until 2026-09-11 13:30:57.585145644 +0000 UTC m=+671.417580760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert") pod "maas-controller-58558d56b9-x5rf5" (UID: "7f1744fd-d112-4b95-8387-e68fdac79d07") : secret "maas-controller-webhook-cert" not found
Sep 11 13:30:57.087684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.087665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.096851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.096812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9826\" (UniqueName: \"kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.389630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.389587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:30:57.591232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.591198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.593618 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.593589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") pod \"maas-controller-58558d56b9-x5rf5\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") " pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:57.778273 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:57.778253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:30:58.057628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:58.057602    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:30:58.059837 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:30:58.059812    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1744fd_d112_4b95_8387_e68fdac79d07.slice/crio-f4cf7f97d420311477dbdaa222661bc07ebe65c818021b6259ef8fc84f4fb3bc WatchSource:0}: Error finding container f4cf7f97d420311477dbdaa222661bc07ebe65c818021b6259ef8fc84f4fb3bc: Status 404 returned error can't find the container with id f4cf7f97d420311477dbdaa222661bc07ebe65c818021b6259ef8fc84f4fb3bc
Sep 11 13:30:58.781653 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:30:58.781607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58558d56b9-x5rf5" event={"ID":"7f1744fd-d112-4b95-8387-e68fdac79d07","Type":"ContainerStarted","Data":"f4cf7f97d420311477dbdaa222661bc07ebe65c818021b6259ef8fc84f4fb3bc"}
Sep 11 13:31:00.665277 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:00.665243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:00.759678 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:00.759578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:00.792970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:00.792940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58558d56b9-x5rf5" event={"ID":"7f1744fd-d112-4b95-8387-e68fdac79d07","Type":"ContainerStarted","Data":"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"}
Sep 11 13:31:00.793139 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:00.793009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:31:00.824858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:00.824816    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58558d56b9-x5rf5" podStartSLOduration=2.431505989 podStartE2EDuration="4.824802293s" totalImagesPullingTime="2.393296304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:31:00.823702531 +0000 UTC m=+674.656137670" watchObservedRunningTime="2026-09-11 13:31:00.824802293 +0000 UTC m=+674.657237463"
Sep 11 13:31:11.807851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:11.807818    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:31:32.359406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:32.359371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:32.492082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:32.492046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:33.936426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:33.936385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.017239 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.017203    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:31:34.021621 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.021591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.037984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.037958    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:31:34.038145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.038043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.040732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.040675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 13:31:34.040732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.040688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:31:34.040911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.040780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x5rkw\""
Sep 11 13:31:34.122291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.122255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.122291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.122289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncp4\" (UniqueName: \"kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.122492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.122411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.122492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.122444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.172380 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.172348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.223433 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.223357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.223433 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.223391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncp4\" (UniqueName: \"kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.223628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.223441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.223628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.223463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.224045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.224022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.225805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.225778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.225911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.225848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.237699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.237676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncp4\" (UniqueName: \"kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4\") pod \"maas-api-67749f9dd-qqdx5\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.274931 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.274889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.348518 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.348464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:34.437117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.437085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.548961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.548927    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:34.641281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.641250    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:31:34.643818 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:31:34.643785    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d3304c_2c33_4115_b3cf_d486fa01261d.slice/crio-b8cbc1de69b826d14b8e80cdf19eb02a51fe9c28df086b02fc2e849d12279c93 WatchSource:0}: Error finding container b8cbc1de69b826d14b8e80cdf19eb02a51fe9c28df086b02fc2e849d12279c93: Status 404 returned error can't find the container with id b8cbc1de69b826d14b8e80cdf19eb02a51fe9c28df086b02fc2e849d12279c93
Sep 11 13:31:34.959910 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:34.959831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" event={"ID":"61d3304c-2c33-4115-b3cf-d486fa01261d","Type":"ContainerStarted","Data":"b8cbc1de69b826d14b8e80cdf19eb02a51fe9c28df086b02fc2e849d12279c93"}
Sep 11 13:31:36.973454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:36.973413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" event={"ID":"61d3304c-2c33-4115-b3cf-d486fa01261d","Type":"ContainerStarted","Data":"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"}
Sep 11 13:31:36.974238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:36.974211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:36.999308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:36.999252    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" podStartSLOduration=2.221780481 podStartE2EDuration="3.99923214s" totalImagesPullingTime="1.777451659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:31:36.998804094 +0000 UTC m=+710.831239232" watchObservedRunningTime="2026-09-11 13:31:36.99923214 +0000 UTC m=+710.831667278"
Sep 11 13:31:43.584654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:43.584620    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:31:43.585022 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:43.584698    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:31:43.994627 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:43.994534    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:31:44.014184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.014152    2582 generic.go:356] "Generic (PLEG): container finished" podID="56339ef8-4199-4434-b47b-e27f01c87a76" containerID="d9627ab8c3f8c247e3ff178a566dcc432543394f7e19ba990929ee234bfb3578" exitCode=0
Sep 11 13:31:44.014333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.014237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" event={"ID":"56339ef8-4199-4434-b47b-e27f01c87a76","Type":"ContainerDied","Data":"d9627ab8c3f8c247e3ff178a566dcc432543394f7e19ba990929ee234bfb3578"}
Sep 11 13:31:44.014763 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.014746    2582 scope.go:117] "RemoveContainer" containerID="d9627ab8c3f8c247e3ff178a566dcc432543394f7e19ba990929ee234bfb3578"
Sep 11 13:31:44.015877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.015848    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:31:44.015971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.015932    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:31:44.016032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:44.015976    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:31:45.020690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.020660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" event={"ID":"56339ef8-4199-4434-b47b-e27f01c87a76","Type":"ContainerStarted","Data":"73070a67b4b8788cd2474cfa2955c9acc36ee3ac5b5179e109d5946335168750"}
Sep 11 13:31:45.107693 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.107656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:45.206274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.206236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:45.527128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.527090    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:31:45.527397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.527373    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:31:45.527486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:45.527430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:31:46.094559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:46.094523    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:46.195932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:46.195896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:46.527868 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:46.527839    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:31:46.528032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:46.527890    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:31:47.528085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:47.528046    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:31:47.528472 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:47.528104    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:31:48.527808 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:48.527771    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:31:48.527980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:48.527825    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:31:49.527576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:49.527543    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wgtg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:31:49.527962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:49.527597    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9" podUID="56339ef8-4199-4434-b47b-e27f01c87a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 13:31:50.531117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:50.531086    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:31:50.531593 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:50.531339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:31:50.532145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:50.532128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wgtg9"
Sep 11 13:31:57.725284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.725244    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"]
Sep 11 13:31:57.733644 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.733616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.742071 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.742049    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 13:31:57.743394 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.743373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:31:57.743943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.743923    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zv5p8\""
Sep 11 13:31:57.744300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.744284    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:31:57.745387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.745369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"]
Sep 11 13:31:57.851084 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.851290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlz7\" (UniqueName: \"kubernetes.io/projected/7116815b-c3a8-4653-b390-4b0071ab347e-kube-api-access-5mlz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.851290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.851290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7116815b-c3a8-4653-b390-4b0071ab347e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.851417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.851417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.851331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.952590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.952795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlz7\" (UniqueName: \"kubernetes.io/projected/7116815b-c3a8-4653-b390-4b0071ab347e-kube-api-access-5mlz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.952795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.952917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7116815b-c3a8-4653-b390-4b0071ab347e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.952917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.953025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.953025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.952973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.953202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.953181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.953262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.953219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.955096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.955075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7116815b-c3a8-4653-b390-4b0071ab347e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.955344 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.955328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7116815b-c3a8-4653-b390-4b0071ab347e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:57.961131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:57.961109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlz7\" (UniqueName: \"kubernetes.io/projected/7116815b-c3a8-4653-b390-4b0071ab347e-kube-api-access-5mlz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf\" (UID: \"7116815b-c3a8-4653-b390-4b0071ab347e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:58.044545 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:58.044494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:31:58.198777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:58.198744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:31:58.318657 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:58.318633    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"]
Sep 11 13:31:58.320840 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:31:58.320806    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7116815b_c3a8_4653_b390_4b0071ab347e.slice/crio-e05b593570c9e3708c2e8eb2b57b8ec5d5677967e5058adb1faa1e029df245ab WatchSource:0}: Error finding container e05b593570c9e3708c2e8eb2b57b8ec5d5677967e5058adb1faa1e029df245ab: Status 404 returned error can't find the container with id e05b593570c9e3708c2e8eb2b57b8ec5d5677967e5058adb1faa1e029df245ab
Sep 11 13:31:59.092752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:31:59.092713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf" event={"ID":"7116815b-c3a8-4653-b390-4b0071ab347e","Type":"ContainerStarted","Data":"e05b593570c9e3708c2e8eb2b57b8ec5d5677967e5058adb1faa1e029df245ab"}
Sep 11 13:32:00.098870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:00.098834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf" event={"ID":"7116815b-c3a8-4653-b390-4b0071ab347e","Type":"ContainerStarted","Data":"e051c8b075a746ffb2be8fa558c4223c458cf790d29019e453e1a0b6f42ae6d4"}
Sep 11 13:32:00.123817 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:00.123767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf" podStartSLOduration=2.166096771 podStartE2EDuration="3.123751884s" totalImagesPullingTime="957.655113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:32:00.123124556 +0000 UTC m=+733.955559694" watchObservedRunningTime="2026-09-11 13:32:00.123751884 +0000 UTC m=+733.956187023"
Sep 11 13:32:04.838080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:04.838044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:32:08.045585 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:08.045549    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:32:08.046252 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:08.045612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:32:08.058066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:08.058042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:32:08.152920 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:08.152897    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf"
Sep 11 13:32:27.211345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.211302    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"]
Sep 11 13:32:27.214758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.214737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.217024 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.217000    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 13:32:27.223998 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.223974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"]
Sep 11 13:32:27.245772 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.245737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:32:27.318556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.318713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78ds\" (UniqueName: \"kubernetes.io/projected/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-kube-api-access-l78ds\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.318713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.318713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.318713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.318869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.318732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.419877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.419838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78ds\" (UniqueName: \"kubernetes.io/projected/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-kube-api-access-l78ds\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.419883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.419914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.419943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.419963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.420099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.420343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.420388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.420518 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.420474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.422142 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.422122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.422457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.422439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.430225 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.430199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78ds\" (UniqueName: \"kubernetes.io/projected/fcfc0db9-f4ed-4765-88d8-6bf15457d76b-kube-api-access-l78ds\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc\" (UID: \"fcfc0db9-f4ed-4765-88d8-6bf15457d76b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.529247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.529219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:27.799522 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.799439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"]
Sep 11 13:32:27.801841 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:32:27.801815    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfc0db9_f4ed_4765_88d8_6bf15457d76b.slice/crio-bd66aacaea1551fc8eefc7e512464031c9142d9f1fea99b4713f4c73bae80741 WatchSource:0}: Error finding container bd66aacaea1551fc8eefc7e512464031c9142d9f1fea99b4713f4c73bae80741: Status 404 returned error can't find the container with id bd66aacaea1551fc8eefc7e512464031c9142d9f1fea99b4713f4c73bae80741
Sep 11 13:32:27.803112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:27.803093    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:32:28.240261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:28.240164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc" event={"ID":"fcfc0db9-f4ed-4765-88d8-6bf15457d76b","Type":"ContainerStarted","Data":"58079ea31e175b9899fd28c4d5e1454b7cfd980e46c0f6ab9ea2a6647e0d61f9"}
Sep 11 13:32:28.240261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:28.240226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc" event={"ID":"fcfc0db9-f4ed-4765-88d8-6bf15457d76b","Type":"ContainerStarted","Data":"bd66aacaea1551fc8eefc7e512464031c9142d9f1fea99b4713f4c73bae80741"}
Sep 11 13:32:35.515109 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.515054    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc" podStartSLOduration=8.338592954 podStartE2EDuration="8.515032866s" totalImagesPullingTime="176.439912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:32:28.261439213 +0000 UTC m=+762.093874375" watchObservedRunningTime="2026-09-11 13:32:35.515032866 +0000 UTC m=+769.347468067"
Sep 11 13:32:35.515611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.515235    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"]
Sep 11 13:32:35.518940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.518917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.521762 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.521742    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 13:32:35.532468 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.532443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"]
Sep 11 13:32:35.599260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.599435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.599435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.599435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.599613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dczfl\" (UniqueName: \"kubernetes.io/projected/e4e0575c-c13b-417b-912a-b14244128839-kube-api-access-dczfl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.599613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.599563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e0575c-c13b-417b-912a-b14244128839-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.607663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.607635    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:32:35.700544 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dczfl\" (UniqueName: \"kubernetes.io/projected/e4e0575c-c13b-417b-912a-b14244128839-kube-api-access-dczfl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e0575c-c13b-417b-912a-b14244128839-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700945 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.700990 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.700922    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.701400 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.701375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.703685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.703662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4e0575c-c13b-417b-912a-b14244128839-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.703822 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.703801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4e0575c-c13b-417b-912a-b14244128839-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.709453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.709430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dczfl\" (UniqueName: \"kubernetes.io/projected/e4e0575c-c13b-417b-912a-b14244128839-kube-api-access-dczfl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pm2d\" (UID: \"e4e0575c-c13b-417b-912a-b14244128839\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:35.829246 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:35.829205    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:36.101560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:36.101473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"]
Sep 11 13:32:36.103985 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:32:36.103941    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e0575c_c13b_417b_912a_b14244128839.slice/crio-61b770db1c6e80ff719c40aba5fb76f504d10596565258398607d27b2ed9b997 WatchSource:0}: Error finding container 61b770db1c6e80ff719c40aba5fb76f504d10596565258398607d27b2ed9b997: Status 404 returned error can't find the container with id 61b770db1c6e80ff719c40aba5fb76f504d10596565258398607d27b2ed9b997
Sep 11 13:32:36.283732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:36.283698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d" event={"ID":"e4e0575c-c13b-417b-912a-b14244128839","Type":"ContainerStarted","Data":"61b770db1c6e80ff719c40aba5fb76f504d10596565258398607d27b2ed9b997"}
Sep 11 13:32:37.289565 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:37.289528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d" event={"ID":"e4e0575c-c13b-417b-912a-b14244128839","Type":"ContainerStarted","Data":"f0e731a520d4d571233ecb9915e28931d259085ae5ab6ed901e7893ca1aa81d2"}
Sep 11 13:32:37.316112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:37.316062    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d" podStartSLOduration=2.149303378 podStartE2EDuration="2.316047099s" totalImagesPullingTime="166.743721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:32:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:32:37.313779871 +0000 UTC m=+771.146215022" watchObservedRunningTime="2026-09-11 13:32:37.316047099 +0000 UTC m=+771.148482257"
Sep 11 13:32:37.530349 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:37.530303    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:37.530564 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:37.530366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:37.550042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:37.549957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:38.305616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:38.305586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc"
Sep 11 13:32:42.097997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:42.097948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:32:45.829703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:45.829656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:45.830108 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:45.829724    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:45.842011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:45.841985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:46.344847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:46.344819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pm2d"
Sep 11 13:32:53.124588 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.124551    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"]
Sep 11 13:32:53.134914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.134879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.137681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.137653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 13:32:53.137827 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.137729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"]
Sep 11 13:32:53.171199 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3953deec-b641-4e1f-92a1-6cc355a5d725-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.171355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.171425 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.171425 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.171552 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171493    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjrx\" (UniqueName: \"kubernetes.io/projected/3953deec-b641-4e1f-92a1-6cc355a5d725-kube-api-access-wqjrx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.171552 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.171526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.207225 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.207171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:32:53.272605 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjrx\" (UniqueName: \"kubernetes.io/projected/3953deec-b641-4e1f-92a1-6cc355a5d725-kube-api-access-wqjrx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.272744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.272744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3953deec-b641-4e1f-92a1-6cc355a5d725-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.272744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.272908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.272908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.272808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.273045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.273024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.273133 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.273111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.273194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.273131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.274938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.274918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3953deec-b641-4e1f-92a1-6cc355a5d725-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.275237 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.275217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3953deec-b641-4e1f-92a1-6cc355a5d725-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.280491 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.280471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjrx\" (UniqueName: \"kubernetes.io/projected/3953deec-b641-4e1f-92a1-6cc355a5d725-kube-api-access-wqjrx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfxw2\" (UID: \"3953deec-b641-4e1f-92a1-6cc355a5d725\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.447611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.447496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:32:53.731357 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:53.731267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"]
Sep 11 13:32:53.735597 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:32:53.735569    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3953deec_b641_4e1f_92a1_6cc355a5d725.slice/crio-adb83dc6845e275a6fcc398f55e05ee67e8fc23228d4b0f192f8b8a32f65d5ac WatchSource:0}: Error finding container adb83dc6845e275a6fcc398f55e05ee67e8fc23228d4b0f192f8b8a32f65d5ac: Status 404 returned error can't find the container with id adb83dc6845e275a6fcc398f55e05ee67e8fc23228d4b0f192f8b8a32f65d5ac
Sep 11 13:32:54.376283 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:54.376247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2" event={"ID":"3953deec-b641-4e1f-92a1-6cc355a5d725","Type":"ContainerStarted","Data":"9f773d98cfec1189c8fa88f83a41ac7797fe45594c8f66f911363414a695b993"}
Sep 11 13:32:54.376681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:54.376304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2" event={"ID":"3953deec-b641-4e1f-92a1-6cc355a5d725","Type":"ContainerStarted","Data":"adb83dc6845e275a6fcc398f55e05ee67e8fc23228d4b0f192f8b8a32f65d5ac"}
Sep 11 13:32:54.397558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:32:54.397496    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2" podStartSLOduration=1.220196228 podStartE2EDuration="1.397480777s" totalImagesPullingTime="177.284549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:32:54.395002463 +0000 UTC m=+788.227437601" watchObservedRunningTime="2026-09-11 13:32:54.397480777 +0000 UTC m=+788.229915946"
Sep 11 13:33:03.448380 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:03.448347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:33:03.448844 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:03.448397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:33:03.460987 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:03.460965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:33:04.195465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:04.195423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:33:04.436929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:04.436903    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfxw2"
Sep 11 13:33:36.192758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:36.192720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:33:36.260830 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:33:36.260797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:13.244450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:13.244410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:13.319724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:13.319695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:26.859236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:26.859186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:33.773298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:33.773259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:34.020622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:34.020583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:35.076971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:35.076927    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:35.168452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:35.168410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:51.183039 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.183005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:51.302857 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.302798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:51.550152 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.550119    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:34:51.553737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.553716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.556417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.556396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-94126e-openshift-default-dockercfg-vnkd9\""
Sep 11 13:34:51.575606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.575572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:34:51.583698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.583669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:51.624413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8db\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.624957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.625101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.624974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.625101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.625006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.725846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.725846 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.725976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8db\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.726801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.726729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.728812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.728779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.729030 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.729014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.734615 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.734592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.735077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.735049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8db\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db\") pod \"e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") " pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:51.829291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.829190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:51.864633 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:51.864600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:52.150892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.150857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:34:52.151710 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:34:52.151682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda681c734_9ab2_4a3e_8c1f_3f768cb73e88.slice/crio-96aec15cfd2c0ca014f1e8cde1d357c7bc83807c5a4e35a1c6a4a0fa7ffffad7 WatchSource:0}: Error finding container 96aec15cfd2c0ca014f1e8cde1d357c7bc83807c5a4e35a1c6a4a0fa7ffffad7: Status 404 returned error can't find the container with id 96aec15cfd2c0ca014f1e8cde1d357c7bc83807c5a4e35a1c6a4a0fa7ffffad7
Sep 11 13:34:52.154035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.154001    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:34:52.154137 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.154067    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:34:52.154137 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.154094    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:34:52.781758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.781727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:52.877935 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.877894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:52.966152 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.966112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerStarted","Data":"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"}
Sep 11 13:34:52.966325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.966164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerStarted","Data":"96aec15cfd2c0ca014f1e8cde1d357c7bc83807c5a4e35a1c6a4a0fa7ffffad7"}
Sep 11 13:34:52.991449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:52.991394    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podStartSLOduration=1.991377281 podStartE2EDuration="1.991377281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:34:52.989449795 +0000 UTC m=+906.821884935" watchObservedRunningTime="2026-09-11 13:34:52.991377281 +0000 UTC m=+906.823812482"
Sep 11 13:34:53.223774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:53.223693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:53.864820 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:53.864789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:53.869664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:53.869634    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:53.971600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:53.971568    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:53.972403 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:53.972381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:34:55.003063 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:55.003022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:55.131800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:55.131743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:56.181899 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.181859    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:34:56.186728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.186707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.189929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.189906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-94126e-serving-cert\""
Sep 11 13:34:56.198689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.198665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:34:56.268272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.268223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:56.274811 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.274775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.274997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.274864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.274997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.274977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.275115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.275069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc867\" (UniqueName: \"kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.362920 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.362887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:56.376142 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.376112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc867\" (UniqueName: \"kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.376319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.376154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.376539 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.376493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.376669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.376638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.377258 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.377237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.379610 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.379585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.379764 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.379738    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.386779 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.386751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc867\" (UniqueName: \"kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867\") pod \"maas-api-e2e-inf-a-94126e-ddb85c699-xhtww\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.463420 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.463334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:56.501549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.501495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:56.839131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.839107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:34:56.839706 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:34:56.839667    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e89b9f_b7d1_4d2b_bf1a_5d2c5a95b251.slice/crio-a9298206051fc288dc365261673a665265176dd5939ce6980557c8b1eaedec1f WatchSource:0}: Error finding container a9298206051fc288dc365261673a665265176dd5939ce6980557c8b1eaedec1f: Status 404 returned error can't find the container with id a9298206051fc288dc365261673a665265176dd5939ce6980557c8b1eaedec1f
Sep 11 13:34:56.988607 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:56.988570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" event={"ID":"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251","Type":"ContainerStarted","Data":"a9298206051fc288dc365261673a665265176dd5939ce6980557c8b1eaedec1f"}
Sep 11 13:34:57.083114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:57.083072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:57.180983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:57.180898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:34:57.994915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:57.994880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" event={"ID":"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251","Type":"ContainerStarted","Data":"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"}
Sep 11 13:34:57.995353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:57.994995    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:34:58.018346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:34:58.018290    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" podStartSLOduration=1.47858063 podStartE2EDuration="2.018274466s" totalImagesPullingTime="539.693836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:34:58.017155588 +0000 UTC m=+911.849590728" watchObservedRunningTime="2026-09-11 13:34:58.018274466 +0000 UTC m=+911.850709614"
Sep 11 13:35:00.092430 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.092393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.199477 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.199443    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.347560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.347446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.447357 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.447311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.729111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.729001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.819267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.819235    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:00.919517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:00.919478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:01.057877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:01.057843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:04.005522 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:04.005469    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:35:05.990438 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:05.990391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:06.538795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:06.538759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:06.660616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:06.660576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:07.172528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:07.172464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:07.340409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:07.340372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:07.702287 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:07.702248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:09.072245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.072212    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:35:09.103419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.103388    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:35:09.104393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.103708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.107887 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.107357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a61c70-serving-cert\""
Sep 11 13:35:09.110749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.109876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:09.220664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.220627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdbqw\" (UniqueName: \"kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.220851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.220786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.220909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.220863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.220909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.220890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.221880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.221856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:09.322319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.322225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.322319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.322292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.322590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.322325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.322590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.322386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdbqw\" (UniqueName: \"kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.323166 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.323139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.325401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.325370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.325536 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.325421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.333638 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.333608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdbqw\" (UniqueName: \"kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw\") pod \"maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.417693 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.417661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:09.697999 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.697971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:35:09.700886 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:35:09.700856    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94d14c3_bc14_41d0_9ce1_8babc4438d82.slice/crio-0b99ff6bfeed358229e0b7d691a7fb56ec824555f9eb13152bf708891ed9f51d WatchSource:0}: Error finding container 0b99ff6bfeed358229e0b7d691a7fb56ec824555f9eb13152bf708891ed9f51d: Status 404 returned error can't find the container with id 0b99ff6bfeed358229e0b7d691a7fb56ec824555f9eb13152bf708891ed9f51d
Sep 11 13:35:09.767064 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.767026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:09.868663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:09.868629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.071127 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.071047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" event={"ID":"e94d14c3-bc14-41d0-9ce1-8babc4438d82","Type":"ContainerStarted","Data":"0b99ff6bfeed358229e0b7d691a7fb56ec824555f9eb13152bf708891ed9f51d"}
Sep 11 13:35:10.097568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.097529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.263746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.263705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.381108 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.381015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.449720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.449685    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:35:10.454053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.454026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.457654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.457479    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-bfc5af-openshift-default-dockercfg-mtq7r\""
Sep 11 13:35:10.474565 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.474535    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:35:10.521546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.521484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.637684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwlz\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.637929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.637875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.638860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.638826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.738871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.738830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.738897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.738942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.738967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.738993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwlz\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739451    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.739597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.740015 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.739990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.740606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.740558    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.742722 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.742678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.742863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.742840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.756620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.756591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.756826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.756801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwlz\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz\") pod \"e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") " pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.768546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.768486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:10.800614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.800584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:10.934886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:10.934800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:11.084072 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.084014    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:35:11.089708 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.089649    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" event={"ID":"e94d14c3-bc14-41d0-9ce1-8babc4438d82","Type":"ContainerStarted","Data":"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"}
Sep 11 13:35:11.089854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.089802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:11.092789 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:35:11.092763    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e128f8f_10f5_4027_a6fe_3c0e80fe509b.slice/crio-9b069c312a249b9bb4ba0767e547cfe2863d7ec51f3b1aad9cc02ddbe5bf8632 WatchSource:0}: Error finding container 9b069c312a249b9bb4ba0767e547cfe2863d7ec51f3b1aad9cc02ddbe5bf8632: Status 404 returned error can't find the container with id 9b069c312a249b9bb4ba0767e547cfe2863d7ec51f3b1aad9cc02ddbe5bf8632
Sep 11 13:35:11.095454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.095420    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:11.095555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.095522    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:11.095555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.095552    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:11.138037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.137990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" podStartSLOduration=1.785914997 podStartE2EDuration="2.137970385s" totalImagesPullingTime="352.055388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:11.134784303 +0000 UTC m=+924.967219445" watchObservedRunningTime="2026-09-11 13:35:11.137970385 +0000 UTC m=+924.970405558"
Sep 11 13:35:11.502738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.502683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:11.865220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:11.865181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:12.097740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.097702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerStarted","Data":"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"}
Sep 11 13:35:12.097923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.097770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerStarted","Data":"9b069c312a249b9bb4ba0767e547cfe2863d7ec51f3b1aad9cc02ddbe5bf8632"}
Sep 11 13:35:12.245756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.245658    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podStartSLOduration=2.245639483 podStartE2EDuration="2.245639483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:12.244028317 +0000 UTC m=+926.076463456" watchObservedRunningTime="2026-09-11 13:35:12.245639483 +0000 UTC m=+926.078074621"
Sep 11 13:35:12.769419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.769381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:12.774428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.774402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:12.876270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:12.876190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:13.104323 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.104290    2582 generic.go:356] "Generic (PLEG): container finished" podID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerID="f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141" exitCode=0
Sep 11 13:35:13.104548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.104365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerDied","Data":"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"}
Sep 11 13:35:13.104824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.104805    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:13.104997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.104983    2582 scope.go:117] "RemoveContainer" containerID="f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"
Sep 11 13:35:13.105867 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.105786    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:13.106124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.106098    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:13.106186 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.106171    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:13.106230 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.106211    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:13.494938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:13.494852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:14.112149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.112115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerStarted","Data":"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"}
Sep 11 13:35:14.475167 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.474965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:14.646866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.646832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:14.785016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.784977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:14.864852 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.864826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:35:14.865051 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.865029    2582 patch_prober.go:28] interesting pod/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 13:35:14.865098 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:14.865086    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 13:35:15.343426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:15.343395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:15.865681 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:15.865645    2582 patch_prober.go:28] interesting pod/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 13:35:15.866065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:15.865699    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 13:35:16.225825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:16.225737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:16.865147 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:16.865109    2582 patch_prober.go:28] interesting pod/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 13:35:16.865344 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:16.865170    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 13:35:17.103451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.103420    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:35:17.254008 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.253913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:17.579253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.579203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:17.802663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.802631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:17.865569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.865468    2582 patch_prober.go:28] interesting pod/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 13:35:17.865569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:17.865550    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 13:35:18.420037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:18.419994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:18.865821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:18.865783    2582 patch_prober.go:28] interesting pod/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 13:35:18.865994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:18.865841    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 13:35:19.627801 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:19.627763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:19.755922 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:19.755886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:19.869650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:19.869620    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:35:19.869917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:19.869892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:35:19.870549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:19.870527    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:35:20.170027 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:20.169993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:20.512685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:20.512588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:20.620241 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:20.620208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:21.434896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:21.434838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:21.980618 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:21.980578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:23.066350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:23.066311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:24.240679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:24.240646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:25.103900 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:25.103865    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:25.956006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:25.955919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:26.114173 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:26.114124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:26.226107 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:26.225874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:26.351785 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:26.351751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:26.456272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:26.456234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:27.409334 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:27.409296    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:28.570932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:28.570897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:29.666063 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:29.666025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:30.705272 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:30.705231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:31.724476 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:31.724438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:33.175326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:33.175292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:33.867147 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:33.867111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:33.989665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:33.989616    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:34.353557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:34.353517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:34.470473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:34.470425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:35.246288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.246207    2582 generic.go:356] "Generic (PLEG): container finished" podID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerID="0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351" exitCode=0
Sep 11 13:35:35.246477 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.246279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerDied","Data":"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"}
Sep 11 13:35:35.246858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.246841    2582 scope.go:117] "RemoveContainer" containerID="0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"
Sep 11 13:35:35.247982 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.247957    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:35.248040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.248021    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:35.248076 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:35.248053    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:35:36.035765 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:36.035728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:36.253184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:36.253149    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerStarted","Data":"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"}
Sep 11 13:35:36.769760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:36.769722    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:36.770074 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:36.770002    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 13:35:36.770074 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:36.770057    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 13:35:37.721874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:37.721838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:37.769029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:37.768995    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 13:35:37.769200 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:37.769051    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 13:35:38.723321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:38.723288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:38.769368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:38.769334    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 13:35:38.769562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:38.769406    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 13:35:39.769532 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:39.769473    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 13:35:39.770028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:39.769573    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 13:35:40.065561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:40.065520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:40.769716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:40.769667    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 13:35:40.770923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:40.770887    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 13:35:41.215286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:41.215242    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:41.773566 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:41.773533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:41.773984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:41.773911    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:41.774757 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:41.774739    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:35:48.256907 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:48.256870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.038242 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.038204    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.136805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.136776    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.245015 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.244974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.336218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.336124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.509239 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.509205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:49.728774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:49.728685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:50.047326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:50.047292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:50.189028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:50.188993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:50.275356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:50.275320    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:50.719260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:50.719196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:50.815965 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:50.815920    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:51.095450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:51.095406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:52.613779 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:52.613743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:53.418038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:53.417998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:53.931683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:53.931638    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:54.034326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:54.034293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:54.601013 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:54.600979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:54.740909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:54.740875    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:54.839448 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:54.839387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:55.353446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:55.353408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:55.601004 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:55.600971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:56.338686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:56.338646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:57.394228 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:57.394191    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:58.217763 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:58.217723    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:58.810232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:58.810198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:35:59.431712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:35:59.431680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:17.918686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:17.918605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:19.161424 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:19.161394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:19.918582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:19.918550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:20.630865 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.630834    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:36:20.633750 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.633731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.636726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.636701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a61c70\"/\"default-dockercfg-65lfk\""
Sep 11 13:36:20.636853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.636757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a61c70\"/\"openshift-service-ca.crt\""
Sep 11 13:36:20.636853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.636790    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-a61c70\"/\"autores-model-a61c70-kserve-self-signed-certs\""
Sep 11 13:36:20.636853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.636814    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-a61c70\"/\"kube-root-ca.crt\""
Sep 11 13:36:20.645685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.645662    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:36:20.671711 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.671673    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:20.758973 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.758937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:20.795050 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.795231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.795231 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.795354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmll\" (UniqueName: \"kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.795354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.795354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.795309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896108 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896108 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmll\" (UniqueName: \"kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896798 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.896984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.896959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.897141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.897086    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.897562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.897450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.900810 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.900788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.907080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.907053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.908694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.908673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmll\" (UniqueName: \"kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll\") pod \"autores-model-a61c70-kserve-959dbf67f-sddqk\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") " pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:20.952409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:20.952383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:21.231353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:21.231324    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:36:21.232730 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:36:21.232695    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa2bcf37_19ed_41d5_892c_207b13ba1d6c.slice/crio-3d3b1f84357eca2ba20a56928cc1e9187736ab69423b6bd3e68f90c9faf99136 WatchSource:0}: Error finding container 3d3b1f84357eca2ba20a56928cc1e9187736ab69423b6bd3e68f90c9faf99136: Status 404 returned error can't find the container with id 3d3b1f84357eca2ba20a56928cc1e9187736ab69423b6bd3e68f90c9faf99136
Sep 11 13:36:21.495922 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:21.495834    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:21.502588 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:21.502560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" event={"ID":"fa2bcf37-19ed-41d5-892c-207b13ba1d6c","Type":"ContainerStarted","Data":"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"}
Sep 11 13:36:21.502723 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:21.502599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" event={"ID":"fa2bcf37-19ed-41d5-892c-207b13ba1d6c","Type":"ContainerStarted","Data":"3d3b1f84357eca2ba20a56928cc1e9187736ab69423b6bd3e68f90c9faf99136"}
Sep 11 13:36:21.528450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:21.528399    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" podStartSLOduration=1.528379368 podStartE2EDuration="1.528379368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:36:21.526880991 +0000 UTC m=+995.359316130" watchObservedRunningTime="2026-09-11 13:36:21.528379368 +0000 UTC m=+995.360814507"
Sep 11 13:36:22.549804 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:22.549772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:23.517727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:23.517687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:25.297471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:25.297438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:25.395038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:25.395005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.168387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.168347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.334567 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.334533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.530139 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.530109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.694930 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.694885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.791706 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.791629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:26.884395 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:26.884356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:27.320285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:27.320243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:27.417561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:27.417529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:27.698386 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:27.698315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:27.791883 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:27.791847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:28.284758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:28.284722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:29.284169 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:29.284128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:29.967491 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:29.967455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:30.165878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:30.165839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:30.280465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:30.280438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:30.953082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:30.953041    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:30.953487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:30.953097    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:30.965696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:30.965668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:31.243335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:31.243244    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:31.569841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:31.569802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:36:32.480878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:32.480836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:33.240352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:33.240322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:34.209601 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:34.209573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:34.308097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:34.308065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:34.408226 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:34.408193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:34.754560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:34.754526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:34.849597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:34.849553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:54.517835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.517800    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:36:54.520845 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.520816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.524384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.524346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-b386d576-kserve-self-signed-certs\""
Sep 11 13:36:54.548229 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.548201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:36:54.565460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.565630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.565630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.565630 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.565744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8drf\" (UniqueName: \"kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.565744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.565698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.608312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.608273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:54.666994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.666956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8drf\" (UniqueName: \"kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667478 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.667662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.667645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.671523 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.671058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.671692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.671609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.677783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.677753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8drf\" (UniqueName: \"kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf\") pod \"e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") " pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:54.831243 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:54.831196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:36:55.114934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:55.114904    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:36:55.115808 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:36:55.115782    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3289f38_1234_47e9_aaad_7075ef3075aa.slice/crio-556db0646e9fedc3de513230f47ce8985193f07bc6272277f296369cc202823a WatchSource:0}: Error finding container 556db0646e9fedc3de513230f47ce8985193f07bc6272277f296369cc202823a: Status 404 returned error can't find the container with id 556db0646e9fedc3de513230f47ce8985193f07bc6272277f296369cc202823a
Sep 11 13:36:55.526118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:55.526088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:55.695047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:55.695003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" event={"ID":"b3289f38-1234-47e9-aaad-7075ef3075aa","Type":"ContainerStarted","Data":"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"}
Sep 11 13:36:55.695215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:55.695057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" event={"ID":"b3289f38-1234-47e9-aaad-7075ef3075aa","Type":"ContainerStarted","Data":"556db0646e9fedc3de513230f47ce8985193f07bc6272277f296369cc202823a"}
Sep 11 13:36:55.718717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:55.718657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" podStartSLOduration=1.7186317450000002 podStartE2EDuration="1.718631745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:36:55.715441856 +0000 UTC m=+1029.547876996" watchObservedRunningTime="2026-09-11 13:36:55.718631745 +0000 UTC m=+1029.551066923"
Sep 11 13:36:56.503770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:56.503724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:57.705393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:57.705307    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:58.100926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:58.100887    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:36:58.161198 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:58.161170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:58.987292 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:58.987257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:36:59.796184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:36:59.796148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:00.785383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:00.785344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:01.822710 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:01.822670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:02.692175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:02.692135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:03.471184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:03.471150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:04.312276 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:04.312241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:04.832107 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:04.832074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:04.832540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:04.832411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:04.844941 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:04.844916    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:05.284392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:05.284359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:05.764309 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:05.764230    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:05.956877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:05.956844    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:37:05.957346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:05.957052    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" podUID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" containerName="maas-api" containerID="cri-o://d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095" gracePeriod=30
Sep 11 13:37:05.992451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:05.992419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.075187 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.075143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.140593 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.140552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.210720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.210694    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:37:06.219495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.219470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.282435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.282388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.288558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.288534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs\") pod \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") "
Sep 11 13:37:06.288669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.288630    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca\") pod \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") "
Sep 11 13:37:06.288725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.288691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls\") pod \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") "
Sep 11 13:37:06.288777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.288750    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdbqw\" (UniqueName: \"kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw\") pod \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\" (UID: \"e94d14c3-bc14-41d0-9ce1-8babc4438d82\") "
Sep 11 13:37:06.289054 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.289019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e94d14c3-bc14-41d0-9ce1-8babc4438d82" (UID: "e94d14c3-bc14-41d0-9ce1-8babc4438d82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:06.289227 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.289207    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94d14c3-bc14-41d0-9ce1-8babc4438d82-openshift-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:06.291093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.291071    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e94d14c3-bc14-41d0-9ce1-8babc4438d82" (UID: "e94d14c3-bc14-41d0-9ce1-8babc4438d82"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:06.291191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.291094    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw" (OuterVolumeSpecName: "kube-api-access-gdbqw") pod "e94d14c3-bc14-41d0-9ce1-8babc4438d82" (UID: "e94d14c3-bc14-41d0-9ce1-8babc4438d82"). InnerVolumeSpecName "kube-api-access-gdbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:06.291191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.291121    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e94d14c3-bc14-41d0-9ce1-8babc4438d82" (UID: "e94d14c3-bc14-41d0-9ce1-8babc4438d82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:06.390174 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.390073    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdbqw\" (UniqueName: \"kubernetes.io/projected/e94d14c3-bc14-41d0-9ce1-8babc4438d82-kube-api-access-gdbqw\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:06.390174 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.390106    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-metrics-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:06.390174 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.390116    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e94d14c3-bc14-41d0-9ce1-8babc4438d82-maas-api-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:06.598517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.598469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.680486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.680395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:06.759698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.759666    2582 generic.go:356] "Generic (PLEG): container finished" podID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" containerID="d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095" exitCode=0
Sep 11 13:37:06.759843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.759714    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"
Sep 11 13:37:06.759843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.759748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" event={"ID":"e94d14c3-bc14-41d0-9ce1-8babc4438d82","Type":"ContainerDied","Data":"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"}
Sep 11 13:37:06.759843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.759795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg" event={"ID":"e94d14c3-bc14-41d0-9ce1-8babc4438d82","Type":"ContainerDied","Data":"0b99ff6bfeed358229e0b7d691a7fb56ec824555f9eb13152bf708891ed9f51d"}
Sep 11 13:37:06.759843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.759817    2582 scope.go:117] "RemoveContainer" containerID="d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"
Sep 11 13:37:06.769435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.769417    2582 scope.go:117] "RemoveContainer" containerID="d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"
Sep 11 13:37:06.769711 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:37:06.769690    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095\": container with ID starting with d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095 not found: ID does not exist" containerID="d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"
Sep 11 13:37:06.769772 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.769719    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095"} err="failed to get container status \"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095\": rpc error: code = NotFound desc = could not find container \"d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095\": container with ID starting with d649ea351b0f173663b4b15a3e7bbbff19558da93cba57d6108294e2f0e11095 not found: ID does not exist"
Sep 11 13:37:06.785889 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.785844    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:37:06.788113 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.788094    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a61c70-55dcb84d68-ggvhg"]
Sep 11 13:37:06.852823 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:06.852793    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" path="/var/lib/kubelet/pods/e94d14c3-bc14-41d0-9ce1-8babc4438d82/volumes"
Sep 11 13:37:07.667606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:07.667571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:08.527196 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:08.527159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:09.350019 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:09.349985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:09.751815 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:09.751727    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:37:09.762697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:09.762666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:11.656417 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:11.656387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:11.757197 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:11.757160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:12.299622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:12.299593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:12.401679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:12.401648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:12.493748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:12.493713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:12.665256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:12.665179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:12.825910 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:12.825878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:13.120093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.120049    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" podUID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" containerName="main" containerID="cri-o://2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f" gracePeriod=45
Sep 11 13:37:13.286047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.286013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:13.385770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.385698    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:37:13.462365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462334    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjmll\" (UniqueName: \"kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462480    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462606    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462656    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache\") pod \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\" (UID: \"fa2bcf37-19ed-41d5-892c-207b13ba1d6c\") "
Sep 11 13:37:13.462752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home" (OuterVolumeSpecName: "home") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:13.462896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.462762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:13.463047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.463031    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.463047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.463029    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache" (OuterVolumeSpecName: "model-cache") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:13.463151 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.463052    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.464690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.464667    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll" (OuterVolumeSpecName: "kube-api-access-cjmll") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "kube-api-access-cjmll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:13.465068 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.465047    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm" (OuterVolumeSpecName: "dshm") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:13.465068 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.465050    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fa2bcf37-19ed-41d5-892c-207b13ba1d6c" (UID: "fa2bcf37-19ed-41d5-892c-207b13ba1d6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:13.564321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.564285    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjmll\" (UniqueName: \"kubernetes.io/projected/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-kube-api-access-cjmll\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.564321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.564314    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.564321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.564324    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.564321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.564332    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa2bcf37-19ed-41d5-892c-207b13ba1d6c-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:13.806159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.806125    2582 generic.go:356] "Generic (PLEG): container finished" podID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" containerID="2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f" exitCode=0
Sep 11 13:37:13.806572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.806171    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"
Sep 11 13:37:13.806572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.806221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" event={"ID":"fa2bcf37-19ed-41d5-892c-207b13ba1d6c","Type":"ContainerDied","Data":"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"}
Sep 11 13:37:13.806572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.806273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk" event={"ID":"fa2bcf37-19ed-41d5-892c-207b13ba1d6c","Type":"ContainerDied","Data":"3d3b1f84357eca2ba20a56928cc1e9187736ab69423b6bd3e68f90c9faf99136"}
Sep 11 13:37:13.806572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.806295    2582 scope.go:117] "RemoveContainer" containerID="2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"
Sep 11 13:37:13.821952 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.821919    2582 scope.go:117] "RemoveContainer" containerID="2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"
Sep 11 13:37:13.822669 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:37:13.822626    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f\": container with ID starting with 2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f not found: ID does not exist" containerID="2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"
Sep 11 13:37:13.822782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.822684    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f"} err="failed to get container status \"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f\": rpc error: code = NotFound desc = could not find container \"2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f\": container with ID starting with 2a798e70359afe317420edd57c0b89fcf33c32d0f4b15de0a6334c2dcc7e9d3f not found: ID does not exist"
Sep 11 13:37:13.846301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.846257    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:37:13.849725 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.849694    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-a61c70/autores-model-a61c70-kserve-959dbf67f-sddqk"]
Sep 11 13:37:13.906990 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:13.906953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:14.229978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:14.229883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:14.408975 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:14.408938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:14.853457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:14.853427    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" path="/var/lib/kubelet/pods/fa2bcf37-19ed-41d5-892c-207b13ba1d6c/volumes"
Sep 11 13:37:15.072450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.072414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:15.082149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082121    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:15.082602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082589    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" containerName="maas-api"
Sep 11 13:37:15.082664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082603    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" containerName="maas-api"
Sep 11 13:37:15.082664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082617    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" containerName="main"
Sep 11 13:37:15.082664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082623    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" containerName="main"
Sep 11 13:37:15.082759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082693    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94d14c3-bc14-41d0-9ce1-8babc4438d82" containerName="maas-api"
Sep 11 13:37:15.082759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.082700    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2bcf37-19ed-41d5-892c-207b13ba1d6c" containerName="main"
Sep 11 13:37:15.085051 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.085035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.087802 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.087783    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-344409b9-openshift-default-dockercfg-zcgqk\""
Sep 11 13:37:15.142676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.142594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:15.180169 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44rmq\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.180654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.180594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282039 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44rmq\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282726 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.282890 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.282869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.283031 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.283011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.284693 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.284670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.284886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.284862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.301069 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.301046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:15.302184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.302159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.302463 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.302444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44rmq\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq\") pod \"e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") " pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.395366 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.395287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:15.545945 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.545903    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:15.690817 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.690792    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:15.693228 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:37:15.693204    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62262bf_f5bf_4a6f_b79e_deb766269f5b.slice/crio-2fd7b0811a028e7a28941b143997c36e55946c2fb3d440960bfebdda046b5f39 WatchSource:0}: Error finding container 2fd7b0811a028e7a28941b143997c36e55946c2fb3d440960bfebdda046b5f39: Status 404 returned error can't find the container with id 2fd7b0811a028e7a28941b143997c36e55946c2fb3d440960bfebdda046b5f39
Sep 11 13:37:15.695588 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.695558    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:15.695655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.695622    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:15.695655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.695649    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:15.822144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.822108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerStarted","Data":"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"}
Sep 11 13:37:15.822330 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.822175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerStarted","Data":"2fd7b0811a028e7a28941b143997c36e55946c2fb3d440960bfebdda046b5f39"}
Sep 11 13:37:15.826419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.826390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:15.847959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:15.847911    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podStartSLOduration=1.8478956370000001 podStartE2EDuration="1.847895637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:15.845040283 +0000 UTC m=+1049.677475421" watchObservedRunningTime="2026-09-11 13:37:15.847895637 +0000 UTC m=+1049.680330776"
Sep 11 13:37:16.395981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:16.395942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:16.401224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:16.401197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:16.827559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:16.827528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:16.828374 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:16.828355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:17.255095 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:17.254978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:17.584823 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:17.584782    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:17.800388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:17.800333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:18.807178 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:18.807144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:19.772127 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:19.772096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.092484 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.092448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.192688 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.192650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.295238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.295198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.400245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.400156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.639005 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.638969    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.737650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.737567    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:21.843416 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:21.843390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:22.152488 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.152455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:22.474783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.474705    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:37:22.478042 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.478021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.480966 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.480939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-cdac79-openshift-default-dockercfg-gsq4p\""
Sep 11 13:37:22.498939 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.498914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:37:22.535166 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.535131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:22.565111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565433 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.565953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlz6p\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.566249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.565990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.566249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.566024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667511 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlz6p\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.667732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.667959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.668013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.668198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.668227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.668525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.668489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.670131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.670110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.670265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.670248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.680495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.680467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlz6p\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.680878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.680857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token\") pod \"e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") " pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.789312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.789278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:22.833667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:22.833622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:23.075709 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.075679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:37:23.077066 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:37:23.077040    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bcd742_dcc7_4589_895e_8379ae5c5565.slice/crio-f16a690bdd92d9cebcd671ca80ddc9c74ffb405d60b8f20e2306513c850b84bb WatchSource:0}: Error finding container f16a690bdd92d9cebcd671ca80ddc9c74ffb405d60b8f20e2306513c850b84bb: Status 404 returned error can't find the container with id f16a690bdd92d9cebcd671ca80ddc9c74ffb405d60b8f20e2306513c850b84bb
Sep 11 13:37:23.079538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.079494    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:23.079601 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.079574    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:23.079639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.079615    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:23.660905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.660868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:23.774569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.774495    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:23.874836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.874795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerStarted","Data":"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"}
Sep 11 13:37:23.875003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.874857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerStarted","Data":"f16a690bdd92d9cebcd671ca80ddc9c74ffb405d60b8f20e2306513c850b84bb"}
Sep 11 13:37:23.904142 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:23.904086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podStartSLOduration=1.904069883 podStartE2EDuration="1.904069883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:23.902022274 +0000 UTC m=+1057.734457414" watchObservedRunningTime="2026-09-11 13:37:23.904069883 +0000 UTC m=+1057.736505021"
Sep 11 13:37:24.772317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:24.772269    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" podUID="b3289f38-1234-47e9-aaad-7075ef3075aa" containerName="main" containerID="cri-o://f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937" gracePeriod=45
Sep 11 13:37:24.789961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:24.789939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:24.795444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:24.795414    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:24.880569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:24.880536    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:24.881469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:24.881444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:25.046550 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.046524    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:25.094906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.094871    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8drf\" (UniqueName: \"kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.094947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.094973    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.095038    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.095061    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.095128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache\") pod \"b3289f38-1234-47e9-aaad-7075ef3075aa\" (UID: \"b3289f38-1234-47e9-aaad-7075ef3075aa\") "
Sep 11 13:37:25.095927 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.095451    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:25.095927 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.095705    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:25.096197 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.096161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home" (OuterVolumeSpecName: "home") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:25.098030 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.097996    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:25.098123 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.098085    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm" (OuterVolumeSpecName: "dshm") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:25.098239 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.098219    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf" (OuterVolumeSpecName: "kube-api-access-c8drf") pod "b3289f38-1234-47e9-aaad-7075ef3075aa" (UID: "b3289f38-1234-47e9-aaad-7075ef3075aa"). InnerVolumeSpecName "kube-api-access-c8drf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:25.196578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196544    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8drf\" (UniqueName: \"kubernetes.io/projected/b3289f38-1234-47e9-aaad-7075ef3075aa-kube-api-access-c8drf\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.196578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196574    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.196578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196583    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.196818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196591    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.196818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196598    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3289f38-1234-47e9-aaad-7075ef3075aa-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.196818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.196607    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3289f38-1234-47e9-aaad-7075ef3075aa-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:25.393614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.393581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:25.887916 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.887878    2582 generic.go:356] "Generic (PLEG): container finished" podID="b3289f38-1234-47e9-aaad-7075ef3075aa" containerID="f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937" exitCode=0
Sep 11 13:37:25.887916 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.887917    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"
Sep 11 13:37:25.888446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.887949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" event={"ID":"b3289f38-1234-47e9-aaad-7075ef3075aa","Type":"ContainerDied","Data":"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"}
Sep 11 13:37:25.888446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.887990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw" event={"ID":"b3289f38-1234-47e9-aaad-7075ef3075aa","Type":"ContainerDied","Data":"556db0646e9fedc3de513230f47ce8985193f07bc6272277f296369cc202823a"}
Sep 11 13:37:25.888446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.888006    2582 scope.go:117] "RemoveContainer" containerID="f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"
Sep 11 13:37:25.897557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.897534    2582 scope.go:117] "RemoveContainer" containerID="f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"
Sep 11 13:37:25.897855 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:37:25.897838    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937\": container with ID starting with f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937 not found: ID does not exist" containerID="f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"
Sep 11 13:37:25.897933 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.897863    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937"} err="failed to get container status \"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937\": rpc error: code = NotFound desc = could not find container \"f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937\": container with ID starting with f3170f1c08230be9833afa5b6e9a19056579680219ff5096524f62856f5d4937 not found: ID does not exist"
Sep 11 13:37:25.941070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.941033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:25.951707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.951631    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:37:25.974329 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:25.974289    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-b386d576-kserve-5cc5878f94-bb8qw"]
Sep 11 13:37:26.201454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:26.201371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:26.711533 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:26.711489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:26.852407 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:26.852375    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3289f38-1234-47e9-aaad-7075ef3075aa" path="/var/lib/kubelet/pods/b3289f38-1234-47e9-aaad-7075ef3075aa/volumes"
Sep 11 13:37:27.899940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:27.899904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:28.884560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:28.884529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:29.646892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:29.646859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:29.926269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:29.926185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:30.002232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:30.002196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:30.101517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:30.101477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:30.604607 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:30.604580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:30.718574 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:30.718539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:31.372716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:31.372674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:32.710233 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:32.710197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:33.667942 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:33.667909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:34.726372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:34.726340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:35.768172 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:35.768110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:36.767730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:36.767680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:37.584581 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:37.584542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:38.959615 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.959583    2582 generic.go:356] "Generic (PLEG): container finished" podID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerID="44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56" exitCode=0
Sep 11 13:37:38.960035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.959658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerDied","Data":"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"}
Sep 11 13:37:38.960110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.960095    2582 scope.go:117] "RemoveContainer" containerID="44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"
Sep 11 13:37:38.961250 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.961221    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:38.961369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.961318    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:38.961369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:38.961358    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:39.967766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:39.967733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerStarted","Data":"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"}
Sep 11 13:37:40.395836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:40.395798    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:40.396171 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:40.396149    2582 patch_prober.go:28] interesting pod/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:37:40.396384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:40.396356    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 13:37:41.397079 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:41.397031    2582 patch_prober.go:28] interesting pod/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:37:41.397719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:41.397666    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 13:37:42.250558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:42.250527    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:42.396041 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:42.395996    2582 patch_prober.go:28] interesting pod/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:37:42.396255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:42.396085    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 13:37:43.269345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.269314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:43.399404 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.398920    2582 patch_prober.go:28] interesting pod/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:37:43.399404 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.399006    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 13:37:43.452115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.452076    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:43.541679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.541648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:43.627979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.627943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:43.714001 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.713965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:43.802262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.802160    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:43.802644 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.802611    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy" containerID="cri-o://c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98" gracePeriod=30
Sep 11 13:37:43.820742 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:43.820710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:44.256896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:44.256791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:44.486084 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:44.486039    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:44.584914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:44.584833    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:44.685742 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:44.685659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:45.302977 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:45.302935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:46.140261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:46.140213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:46.285200 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:46.285154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:46.827959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:46.827922    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:47.021435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.021336    2582 generic.go:356] "Generic (PLEG): container finished" podID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerID="a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393" exitCode=0
Sep 11 13:37:47.021435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.021400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerDied","Data":"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"}
Sep 11 13:37:47.021883 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.021869    2582 scope.go:117] "RemoveContainer" containerID="a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"
Sep 11 13:37:47.023072 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.023029    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:47.023170 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.023123    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:47.023170 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.023156    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:37:47.274765 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:47.274667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:48.031381 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:48.031349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerStarted","Data":"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"}
Sep 11 13:37:48.310315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:48.310230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:48.790744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:48.790704    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:48.790980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:48.790835    2582 patch_prober.go:28] interesting pod/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 13:37:48.790980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:48.790878    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 13:37:49.524257 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:49.524219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:49.789719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:49.789681    2582 patch_prober.go:28] interesting pod/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 13:37:49.789918 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:49.789750    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 13:37:50.657331 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.657302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:50.705059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.705029    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:50.796962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.796928    2582 patch_prober.go:28] interesting pod/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 13:37:50.797236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.797208    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 13:37:50.809923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.809895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.809956    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.809994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44rmq\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810121    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810186    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810198    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:50.810370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810266    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:50.810370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810281    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert\") pod \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\" (UID: \"a62262bf-f5bf-4a6f-b79e-deb766269f5b\") "
Sep 11 13:37:50.810669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810422    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:50.810669 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810650    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:50.810783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810701    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:50.810783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810705    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.810783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810732    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.810783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.810745    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.812301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.812274    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq" (OuterVolumeSpecName: "kube-api-access-44rmq") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "kube-api-access-44rmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:50.812648 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.812619    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:50.812729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.812696    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:37:50.812831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.812816    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a62262bf-f5bf-4a6f-b79e-deb766269f5b" (UID: "a62262bf-f5bf-4a6f-b79e-deb766269f5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:50.912206 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912161    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.912390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912221    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44rmq\" (UniqueName: \"kubernetes.io/projected/a62262bf-f5bf-4a6f-b79e-deb766269f5b-kube-api-access-44rmq\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.912390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912235    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.912390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912244    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.912390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912252    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.912390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.912260    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62262bf-f5bf-4a6f-b79e-deb766269f5b-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:37:50.942387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:50.942355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:51.049542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.049432    2582 generic.go:356] "Generic (PLEG): container finished" podID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerID="c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98" exitCode=0
Sep 11 13:37:51.049542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.049514    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"
Sep 11 13:37:51.049542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.049523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerDied","Data":"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"}
Sep 11 13:37:51.049780 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.049580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf" event={"ID":"a62262bf-f5bf-4a6f-b79e-deb766269f5b","Type":"ContainerDied","Data":"2fd7b0811a028e7a28941b143997c36e55946c2fb3d440960bfebdda046b5f39"}
Sep 11 13:37:51.049780 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.049612    2582 scope.go:117] "RemoveContainer" containerID="c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"
Sep 11 13:37:51.058691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.058672    2582 scope.go:117] "RemoveContainer" containerID="44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"
Sep 11 13:37:51.067250 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.067221    2582 scope.go:117] "RemoveContainer" containerID="c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"
Sep 11 13:37:51.067544 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:37:51.067524    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98\": container with ID starting with c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98 not found: ID does not exist" containerID="c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"
Sep 11 13:37:51.067611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.067553    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98"} err="failed to get container status \"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98\": rpc error: code = NotFound desc = could not find container \"c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98\": container with ID starting with c734b7885c9016d8948d1b59ce24a0c20f72d1d4ccbe891846036d8167124b98 not found: ID does not exist"
Sep 11 13:37:51.067611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.067571    2582 scope.go:117] "RemoveContainer" containerID="44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"
Sep 11 13:37:51.067827 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:37:51.067810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56\": container with ID starting with 44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56 not found: ID does not exist" containerID="44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"
Sep 11 13:37:51.067917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.067829    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56"} err="failed to get container status \"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56\": rpc error: code = NotFound desc = could not find container \"44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56\": container with ID starting with 44e562f257c778aea6f0f296b436f4b47be6f1c8b6c8f815d73ac0568ca65a56 not found: ID does not exist"
Sep 11 13:37:51.071452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.071423    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:51.079979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.079943    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-344409b9-openshift-default-857848d4f6-vfgwf"]
Sep 11 13:37:51.632743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.632698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:51.790277 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.790232    2582 patch_prober.go:28] interesting pod/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 13:37:51.790757 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:51.790331    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 13:37:52.790210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:52.790169    2582 patch_prober.go:28] interesting pod/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 11 13:37:52.790536 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:52.790486    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 11 13:37:52.798337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:52.798290    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:52.853096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:52.853067    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" path="/var/lib/kubelet/pods/a62262bf-f5bf-4a6f-b79e-deb766269f5b/volumes"
Sep 11 13:37:53.003977 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.003942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:53.110298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.110220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:53.234797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.234768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:53.335154 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.335113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:53.779157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.779120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:37:53.793876 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.793848    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:53.794296 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.794226    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:53.795037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:53.795022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:37:55.452580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:37:55.452546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:13.704624 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:13.704587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:15.865160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:15.865120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:15.948238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:15.948208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:20.248818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:20.248786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:38.896400 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:38.896364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:39.975951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:39.975897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:41.043319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:41.043287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:41.175211 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:41.175180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:41.402206 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:41.402120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:41.541516 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:41.541481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:42.410236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:42.410196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:43.292926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:43.292891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:49.749696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:49.749663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:49.856255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:49.856194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:49.975687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:49.975657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:50.063112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:50.063052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:50.161225 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:50.161190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:50.460240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:50.460150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:50.639337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:50.639300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:51.731133 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:51.731099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:52.554124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:52.554092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:52.691340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:52.691306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:53.196137 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:53.196104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:57.174798 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.174762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:57.273149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.273121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:57.430583 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.430465    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:38:57.430819 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.430789    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy" containerID="cri-o://fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4" gracePeriod=30
Sep 11 13:38:57.454406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.454376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:57.895803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:57.895770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:58.282979 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:58.282944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:58.372340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:58.372309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:38:59.895547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:38:59.895489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:00.038734 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:00.038687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:00.162054 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:00.161984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:02.699175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.699118    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:39:02.758327 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758289    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758413    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758491    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758575    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:02.758620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlz6p\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo\") pod \"a6bcd742-dcc7-4589-895e-8379ae5c5565\" (UID: \"a6bcd742-dcc7-4589-895e-8379ae5c5565\") "
Sep 11 13:39:02.758988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:02.758988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.758835    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:02.759103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759039    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:02.759155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759144    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.759209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759163    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.759209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759164    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:39:02.759209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759177    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.759209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.759194    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.761082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.761053    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:02.761216 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.761057    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p" (OuterVolumeSpecName: "kube-api-access-dlz6p") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "kube-api-access-dlz6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:02.761394 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.761374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:02.761471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.761374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6bcd742-dcc7-4589-895e-8379ae5c5565" (UID: "a6bcd742-dcc7-4589-895e-8379ae5c5565"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:39:02.860247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.860221    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlz6p\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-kube-api-access-dlz6p\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.860247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.860245    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.860437 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.860254    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.860437 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.860262    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bcd742-dcc7-4589-895e-8379ae5c5565-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:02.860437 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:02.860270    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6bcd742-dcc7-4589-895e-8379ae5c5565-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:03.447848 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.447815    2582 generic.go:356] "Generic (PLEG): container finished" podID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerID="fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4" exitCode=0
Sep 11 13:39:03.448046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.447874    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"
Sep 11 13:39:03.448046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.447897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerDied","Data":"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"}
Sep 11 13:39:03.448046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.447972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww" event={"ID":"a6bcd742-dcc7-4589-895e-8379ae5c5565","Type":"ContainerDied","Data":"f16a690bdd92d9cebcd671ca80ddc9c74ffb405d60b8f20e2306513c850b84bb"}
Sep 11 13:39:03.448046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.448003    2582 scope.go:117] "RemoveContainer" containerID="fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"
Sep 11 13:39:03.457117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.457087    2582 scope.go:117] "RemoveContainer" containerID="a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"
Sep 11 13:39:03.465731 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.465713    2582 scope.go:117] "RemoveContainer" containerID="fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"
Sep 11 13:39:03.466142 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:03.466121    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4\": container with ID starting with fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4 not found: ID does not exist" containerID="fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"
Sep 11 13:39:03.466224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.466150    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4"} err="failed to get container status \"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4\": rpc error: code = NotFound desc = could not find container \"fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4\": container with ID starting with fe3e26c3d2fb9cea910ebeb8732f24a00b916eedb7a9f90385a3bbbec202e8a4 not found: ID does not exist"
Sep 11 13:39:03.466224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.466165    2582 scope.go:117] "RemoveContainer" containerID="a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"
Sep 11 13:39:03.466392 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:03.466376    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393\": container with ID starting with a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393 not found: ID does not exist" containerID="a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"
Sep 11 13:39:03.466443 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.466398    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393"} err="failed to get container status \"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393\": rpc error: code = NotFound desc = could not find container \"a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393\": container with ID starting with a2a6daf88d5b9e22221e5c15b0ddde98f0071332379f267ed9028c2b3f8f3393 not found: ID does not exist"
Sep 11 13:39:03.467898 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.467878    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:39:03.474114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.474094    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-cdac79-openshift-default-7486bf7b8-vwvww"]
Sep 11 13:39:03.720728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.720659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:03.822122 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.822090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:03.924482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:03.924446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:04.852868 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:04.852838    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" path="/var/lib/kubelet/pods/a6bcd742-dcc7-4589-895e-8379ae5c5565/volumes"
Sep 11 13:39:06.095791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.095758    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:06.096189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096177    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:39:06.096189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096190    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096201    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096207    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096221    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096226    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096233    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096237    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096250    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3289f38-1234-47e9-aaad-7075ef3075aa" containerName="main"
Sep 11 13:39:06.096300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096258    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3289f38-1234-47e9-aaad-7075ef3075aa" containerName="main"
Sep 11 13:39:06.096612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096318    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:39:06.096612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096326    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:39:06.096612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.096336    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3289f38-1234-47e9-aaad-7075ef3075aa" containerName="main"
Sep 11 13:39:06.100890 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.100872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.103371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.103351    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f94333\"/\"openshift-service-ca.crt\""
Sep 11 13:39:06.104112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.104095    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f94333\"/\"noten-model-f94333-kserve-self-signed-certs\""
Sep 11 13:39:06.104183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.104152    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f94333\"/\"default-dockercfg-r2rx4\""
Sep 11 13:39:06.104226 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.104157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f94333\"/\"kube-root-ca.crt\""
Sep 11 13:39:06.107797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.107775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:06.190390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.190359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.190560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.190425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.190908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.190451    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.191032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.190976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.191099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.191040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5bn5\" (UniqueName: \"kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.191099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.191087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.223701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.223673    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:06.291690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.291816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.291816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.291914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5bn5\" (UniqueName: \"kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.291914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.292014 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.291990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.292093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.292075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.292281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.292264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.292355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.292264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.293907 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.293878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.294175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.294156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.299811 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.299791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5bn5\" (UniqueName: \"kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5\") pod \"noten-model-f94333-kserve-5c6b6c5675-js9lp\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") " pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.422390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.422311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:06.698744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:06.698716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:06.700464 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:39:06.700435    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf03bc6e8_1e44_47af_8783_68d80f414248.slice/crio-169c814854d2ad1ac384a2e6a7d1971511c460d442a0e8e97abcd5850f4eaec5 WatchSource:0}: Error finding container 169c814854d2ad1ac384a2e6a7d1971511c460d442a0e8e97abcd5850f4eaec5: Status 404 returned error can't find the container with id 169c814854d2ad1ac384a2e6a7d1971511c460d442a0e8e97abcd5850f4eaec5
Sep 11 13:39:07.473019 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:07.472980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" event={"ID":"f03bc6e8-1e44-47af-8783-68d80f414248","Type":"ContainerStarted","Data":"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"}
Sep 11 13:39:07.473391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:07.473028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" event={"ID":"f03bc6e8-1e44-47af-8783-68d80f414248","Type":"ContainerStarted","Data":"169c814854d2ad1ac384a2e6a7d1971511c460d442a0e8e97abcd5850f4eaec5"}
Sep 11 13:39:07.492639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:07.492591    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" podStartSLOduration=1.492577645 podStartE2EDuration="1.492577645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:39:07.490356394 +0000 UTC m=+1161.322791533" watchObservedRunningTime="2026-09-11 13:39:07.492577645 +0000 UTC m=+1161.325012785"
Sep 11 13:39:14.455800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:14.455724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:15.239819 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:15.239784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:16.422985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:16.422951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:16.422985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:16.422997    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:16.435756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:16.435731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:16.539301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:16.536954    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:21.342387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:21.342352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:21.413306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:21.413278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:21.536634 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:21.536601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:21.671524 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:21.671427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:21.801251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:21.801218    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:22.403047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:22.403013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:22.561573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:22.561538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:24.133987 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:24.133953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:27.725048 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:27.725018    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:27.747742 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:27.747711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:27.870035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:27.870003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:28.114114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:28.114081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:28.236787 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:28.236753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:30.611765 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:30.611734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:30.712471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:30.712441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:31.355650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:31.355604    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:31.512182 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:31.512152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:32.492827 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:32.492791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:32.889441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:32.889411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:33.292284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:33.292244    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:33.788234 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:33.788203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:34.582218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:34.582167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:35.537678 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:35.537642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:37.667429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:37.667397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:37.771261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:37.771216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:37.907027 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:37.906993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:38.299040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:38.299011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:38.576483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:38.576400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:41.268384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:41.268345    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:41.913851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:41.913788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:42.043674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:42.043646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:42.452628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:42.452590    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:42.746159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:42.746076    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" podUID="f03bc6e8-1e44-47af-8783-68d80f414248" containerName="main" containerID="cri-o://91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0" gracePeriod=45
Sep 11 13:39:42.994946 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:42.994921    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:43.051082 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051106    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051189    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5bn5\" (UniqueName: \"kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051303    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051321    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home" (OuterVolumeSpecName: "home") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:43.051460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache\") pod \"f03bc6e8-1e44-47af-8783-68d80f414248\" (UID: \"f03bc6e8-1e44-47af-8783-68d80f414248\") "
Sep 11 13:39:43.051638 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051615    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:43.051727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051704    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache" (OuterVolumeSpecName: "model-cache") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:43.051866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051849    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.051925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051873    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.051925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.051887    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.053783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.053759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm" (OuterVolumeSpecName: "dshm") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:43.053877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.053792    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5" (OuterVolumeSpecName: "kube-api-access-c5bn5") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "kube-api-access-c5bn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:43.053877 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.053838    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f03bc6e8-1e44-47af-8783-68d80f414248" (UID: "f03bc6e8-1e44-47af-8783-68d80f414248"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:39:43.152988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.152952    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03bc6e8-1e44-47af-8783-68d80f414248-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.152988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.152982    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03bc6e8-1e44-47af-8783-68d80f414248-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.152988 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.152991    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5bn5\" (UniqueName: \"kubernetes.io/projected/f03bc6e8-1e44-47af-8783-68d80f414248-kube-api-access-c5bn5\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.378291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.378205    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:39:43.378460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.378417    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" podUID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" containerName="maas-api" containerID="cri-o://81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be" gracePeriod=30
Sep 11 13:39:43.393259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.393228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.526853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.526811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.618066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.618042    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:39:43.629786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.629719    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.657974 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.657936    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca\") pod \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") "
Sep 11 13:39:43.658126 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.658078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs\") pod \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") "
Sep 11 13:39:43.658246 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.658127    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc867\" (UniqueName: \"kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867\") pod \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") "
Sep 11 13:39:43.658246 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.658153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls\") pod \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\" (UID: \"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251\") "
Sep 11 13:39:43.658370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.658304    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" (UID: "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:39:43.658713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.658692    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-openshift-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.660496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.660465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" (UID: "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:39:43.660606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.660538    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" (UID: "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:39:43.660839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.660822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867" (OuterVolumeSpecName: "kube-api-access-xc867") pod "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" (UID: "20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251"). InnerVolumeSpecName "kube-api-access-xc867". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:43.672692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.672667    2582 generic.go:356] "Generic (PLEG): container finished" podID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" containerID="81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be" exitCode=0
Sep 11 13:39:43.672799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.672726    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"
Sep 11 13:39:43.672799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.672764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" event={"ID":"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251","Type":"ContainerDied","Data":"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"}
Sep 11 13:39:43.672915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.672813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww" event={"ID":"20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251","Type":"ContainerDied","Data":"a9298206051fc288dc365261673a665265176dd5939ce6980557c8b1eaedec1f"}
Sep 11 13:39:43.672915 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.672836    2582 scope.go:117] "RemoveContainer" containerID="81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"
Sep 11 13:39:43.674266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.674244    2582 generic.go:356] "Generic (PLEG): container finished" podID="f03bc6e8-1e44-47af-8783-68d80f414248" containerID="91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0" exitCode=0
Sep 11 13:39:43.674360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.674335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" event={"ID":"f03bc6e8-1e44-47af-8783-68d80f414248","Type":"ContainerDied","Data":"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"}
Sep 11 13:39:43.674411 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.674364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp" event={"ID":"f03bc6e8-1e44-47af-8783-68d80f414248","Type":"ContainerDied","Data":"169c814854d2ad1ac384a2e6a7d1971511c460d442a0e8e97abcd5850f4eaec5"}
Sep 11 13:39:43.674447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.674421    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"
Sep 11 13:39:43.687837 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.687815    2582 scope.go:117] "RemoveContainer" containerID="81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"
Sep 11 13:39:43.688189 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:43.688156    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be\": container with ID starting with 81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be not found: ID does not exist" containerID="81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"
Sep 11 13:39:43.688282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.688196    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be"} err="failed to get container status \"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be\": rpc error: code = NotFound desc = could not find container \"81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be\": container with ID starting with 81782fac5d7d387b729ebd0d080b5a28f1e4d915496e5811a1656cb12ae0a5be not found: ID does not exist"
Sep 11 13:39:43.688282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.688219    2582 scope.go:117] "RemoveContainer" containerID="91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"
Sep 11 13:39:43.696792 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.696777    2582 scope.go:117] "RemoveContainer" containerID="91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"
Sep 11 13:39:43.697037 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:43.697017    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0\": container with ID starting with 91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0 not found: ID does not exist" containerID="91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"
Sep 11 13:39:43.697080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.697043    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0"} err="failed to get container status \"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0\": rpc error: code = NotFound desc = could not find container \"91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0\": container with ID starting with 91ef68a79082266c2bc0c82f77975a0df6d5b9d188d0c949675831c0394ebaf0 not found: ID does not exist"
Sep 11 13:39:43.701729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.701708    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:43.705824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.705804    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-f94333/noten-model-f94333-kserve-5c6b6c5675-js9lp"]
Sep 11 13:39:43.708303 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.708281    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.719334 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.719286    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:39:43.736403 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.736375    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-94126e-ddb85c699-xhtww"]
Sep 11 13:39:43.759555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.759494    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-metrics-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.759709 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.759561    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc867\" (UniqueName: \"kubernetes.io/projected/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-kube-api-access-xc867\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.759709 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.759577    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251-maas-api-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:43.802526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.802483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.881821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.881162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:43.966703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:43.966675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:44.124193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:44.124162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:44.550989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:44.550953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:44.680139 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:44.680101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:44.853836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:44.853759    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" path="/var/lib/kubelet/pods/20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251/volumes"
Sep 11 13:39:44.854306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:44.854290    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03bc6e8-1e44-47af-8783-68d80f414248" path="/var/lib/kubelet/pods/f03bc6e8-1e44-47af-8783-68d80f414248/volumes"
Sep 11 13:39:45.073254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:45.073224    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:45.986398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:45.986360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:46.963369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:46.963332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:48.418562 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:48.418526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:50.087829 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:50.087798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:50.166365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:50.166332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:50.425947 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:50.425876    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:39:50.426125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:50.426100    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy" containerID="cri-o://99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496" gracePeriod=30
Sep 11 13:39:50.532312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:50.532279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:51.107439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:51.107408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:52.057559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:52.057528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:52.993843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:52.993812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:53.836848 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:53.836811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:54.666164 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:54.666132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:55.572459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.572421    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:55.685812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.685788    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:39:55.743100 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.743014    2582 generic.go:356] "Generic (PLEG): container finished" podID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerID="99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496" exitCode=0
Sep 11 13:39:55.743261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.743120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerDied","Data":"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"}
Sep 11 13:39:55.743261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.743214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw" event={"ID":"a681c734-9ab2-4a3e-8c1f-3f768cb73e88","Type":"ContainerDied","Data":"96aec15cfd2c0ca014f1e8cde1d357c7bc83807c5a4e35a1c6a4a0fa7ffffad7"}
Sep 11 13:39:55.743367 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.743259    2582 scope.go:117] "RemoveContainer" containerID="99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"
Sep 11 13:39:55.743628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.743457    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"
Sep 11 13:39:55.752393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.752372    2582 scope.go:117] "RemoveContainer" containerID="f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"
Sep 11 13:39:55.760375 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.760356    2582 scope.go:117] "RemoveContainer" containerID="99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"
Sep 11 13:39:55.760661 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:55.760643    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496\": container with ID starting with 99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496 not found: ID does not exist" containerID="99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"
Sep 11 13:39:55.760705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.760668    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496"} err="failed to get container status \"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496\": rpc error: code = NotFound desc = could not find container \"99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496\": container with ID starting with 99308aea0b00a456aee8b2a10f5fa5b74aa29fb3f9b51371d6964d15a17fe496 not found: ID does not exist"
Sep 11 13:39:55.760705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.760684    2582 scope.go:117] "RemoveContainer" containerID="f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"
Sep 11 13:39:55.760908 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:39:55.760892    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141\": container with ID starting with f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141 not found: ID does not exist" containerID="f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"
Sep 11 13:39:55.760954 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.760911    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141"} err="failed to get container status \"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141\": rpc error: code = NotFound desc = could not find container \"f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141\": container with ID starting with f781a89e6b97ac14469ac551d8667d8a17fb24cd7d2a2cb8b94739f1364d1141 not found: ID does not exist"
Sep 11 13:39:55.786377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786355    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm8db\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786431    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786584    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786645    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert\") pod \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\" (UID: \"a681c734-9ab2-4a3e-8c1f-3f768cb73e88\") "
Sep 11 13:39:55.786886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data" (OuterVolumeSpecName: "istio-data") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:55.787038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.786990    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:55.787038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787009    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:55.787260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787186    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.787260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787211    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.787260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787225    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.787437 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787263    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:55.787437 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.787327    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:39:55.788647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.788622    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db" (OuterVolumeSpecName: "kube-api-access-zm8db") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "kube-api-access-zm8db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:55.788751 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.788733    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:39:55.788804 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.788784    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token" (OuterVolumeSpecName: "istio-token") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:55.788841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.788813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a681c734-9ab2-4a3e-8c1f-3f768cb73e88" (UID: "a681c734-9ab2-4a3e-8c1f-3f768cb73e88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:55.888348 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888315    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm8db\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-kube-api-access-zm8db\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.888348 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888342    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.888348 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888351    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.888578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888359    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.888578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888367    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:55.888578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:55.888375    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a681c734-9ab2-4a3e-8c1f-3f768cb73e88-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:39:56.067095 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:56.067065    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:39:56.072492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:56.072469    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-94126e-openshift-default-5bff869cc6-cqwpw"]
Sep 11 13:39:56.553497 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:56.553467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:56.710130 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:56.710104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:56.853051 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:56.852975    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" path="/var/lib/kubelet/pods/a681c734-9ab2-4a3e-8c1f-3f768cb73e88/volumes"
Sep 11 13:39:57.333976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:57.333934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:57.437267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:57.437239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:39:57.733696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:39:57.733614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:01.627013 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:01.626978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:01.720122 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:01.720076    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:01.903361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:01.903262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:02.083416 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:02.083379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:02.236843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:02.236752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:02.435548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:02.435512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:02.645621 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:02.645585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:03.362028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:03.361995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:04.436814 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:04.436773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:04.518164 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:04.518121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:05.808128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:05.808100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:06.664654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:06.664612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:09.285989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:09.285954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:09.370653 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:09.370615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:09.566918 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:09.566840    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:40:09.567077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:09.567054    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" containerID="cri-o://5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2" gracePeriod=30
Sep 11 13:40:09.594264 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:09.594234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:10.190055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.190024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:10.523337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523247    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:40:10.523898 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523876    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523901    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523912    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523919    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523941    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03bc6e8-1e44-47af-8783-68d80f414248" containerName="main"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523951    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03bc6e8-1e44-47af-8783-68d80f414248" containerName="main"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523965    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" containerName="maas-api"
Sep 11 13:40:10.523992 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.523973    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" containerName="maas-api"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524101    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03bc6e8-1e44-47af-8783-68d80f414248" containerName="main"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524117    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524128    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62262bf-f5bf-4a6f-b79e-deb766269f5b" containerName="istio-proxy"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524137    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e89b9f-b7d1-4d2b-bf1a-5d2c5a95b251" containerName="maas-api"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524146    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bcd742-dcc7-4589-895e-8379ae5c5565" containerName="istio-proxy"
Sep 11 13:40:10.524333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.524158    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a681c734-9ab2-4a3e-8c1f-3f768cb73e88" containerName="istio-proxy"
Sep 11 13:40:10.528943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.528923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.532224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.532201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-3dd80c-openshift-default-dockercfg-jlpc7\""
Sep 11 13:40:10.542760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.542731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:40:10.602244 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.602174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:10.640447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640447 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8srms\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.640896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.640837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.741909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.741874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.741943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.741978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.741997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8srms\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742439 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742741 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.742816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.742790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.744492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.744472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.744614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.744566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.750931 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.750908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.751070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.751053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8srms\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms\") pod \"e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") " pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:10.839342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:10.839307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:11.061933 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.061892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:11.128080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.128057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:40:11.129992 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:40:11.129964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528d7aab_026f_4dc8_8b48_588dfc15c6af.slice/crio-23421fe4f83ce4cad3936671bb9b0ba4a81c79d309f505f918df8eff5114834d WatchSource:0}: Error finding container 23421fe4f83ce4cad3936671bb9b0ba4a81c79d309f505f918df8eff5114834d: Status 404 returned error can't find the container with id 23421fe4f83ce4cad3936671bb9b0ba4a81c79d309f505f918df8eff5114834d
Sep 11 13:40:11.132426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.132389    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:11.132524 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.132488    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:11.132597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.132579    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:11.180233 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.180178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:11.776401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.776365    2582 patch_prober.go:28] interesting pod/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:40:11.776769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.776427    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:40:11.825700 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.825667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerStarted","Data":"7d687d5d0a346855c984d94d1598178fc5006ed8a90e7e73e3e43891ad6eec88"}
Sep 11 13:40:11.825858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.825719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerStarted","Data":"23421fe4f83ce4cad3936671bb9b0ba4a81c79d309f505f918df8eff5114834d"}
Sep 11 13:40:11.839932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:11.839911    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:12.845674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:12.845645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:12.868582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:12.868534    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podStartSLOduration=2.868496403 podStartE2EDuration="2.868496403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:11.862975829 +0000 UTC m=+1225.695410968" watchObservedRunningTime="2026-09-11 13:40:12.868496403 +0000 UTC m=+1226.700931541"
Sep 11 13:40:13.207739 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:13.207658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:13.836220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:13.836184    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:13.837178 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:13.837160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:13.889308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:13.889271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.049175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.049137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.317357 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.317322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.408985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.408953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.508836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.508792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.821102 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.821071    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:40:14.843373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.843302    2582 generic.go:356] "Generic (PLEG): container finished" podID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerID="5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2" exitCode=0
Sep 11 13:40:14.843373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.843353    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"
Sep 11 13:40:14.843543 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.843386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerDied","Data":"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"}
Sep 11 13:40:14.843543 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.843441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd" event={"ID":"6e128f8f-10f5-4027-a6fe-3c0e80fe509b","Type":"ContainerDied","Data":"9b069c312a249b9bb4ba0767e547cfe2863d7ec51f3b1aad9cc02ddbe5bf8632"}
Sep 11 13:40:14.843543 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.843465    2582 scope.go:117] "RemoveContainer" containerID="5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"
Sep 11 13:40:14.855395 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.855368    2582 scope.go:117] "RemoveContainer" containerID="0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"
Sep 11 13:40:14.868585 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.868541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.868667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.868631    2582 scope.go:117] "RemoveContainer" containerID="5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"
Sep 11 13:40:14.868963 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:40:14.868934    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2\": container with ID starting with 5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2 not found: ID does not exist" containerID="5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"
Sep 11 13:40:14.869029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.868971    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2"} err="failed to get container status \"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2\": rpc error: code = NotFound desc = could not find container \"5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2\": container with ID starting with 5955a5a73694d0dfe28536b4edfa030d2975109cd2eb4b1ad9ac83b6631e44b2 not found: ID does not exist"
Sep 11 13:40:14.869029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.868989    2582 scope.go:117] "RemoveContainer" containerID="0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"
Sep 11 13:40:14.869263 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:40:14.869247    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351\": container with ID starting with 0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351 not found: ID does not exist" containerID="0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"
Sep 11 13:40:14.869306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.869268    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351"} err="failed to get container status \"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351\": rpc error: code = NotFound desc = could not find container \"0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351\": container with ID starting with 0f3f36193a526bc18c786c1dbc85f47e82863a87d8add0b7a0418e69a80ec351 not found: ID does not exist"
Sep 11 13:40:14.884751 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.884878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.884878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.884878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884852    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884902    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.884929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885047 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885020    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885060    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwwlz\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz\") pod \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\" (UID: \"6e128f8f-10f5-4027-a6fe-3c0e80fe509b\") "
Sep 11 13:40:14.885203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885102    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:14.885203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:14.885203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885159    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:14.885465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885296    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:14.885465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885454    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.885603 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885472    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.885603 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885482    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.885603 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885490    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.885603 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.885465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:40:14.887311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.887284    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:40:14.887538 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.887491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz" (OuterVolumeSpecName: "kube-api-access-zwwlz") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "kube-api-access-zwwlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:14.887685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.887669    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:14.887756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.887741    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e128f8f-10f5-4027-a6fe-3c0e80fe509b" (UID: "6e128f8f-10f5-4027-a6fe-3c0e80fe509b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:14.953856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.953826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:14.986567 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.986492    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.986567 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.986547    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.986567 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.986562    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.986791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.986575    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwwlz\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-kube-api-access-zwwlz\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.986791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:14.986590    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e128f8f-10f5-4027-a6fe-3c0e80fe509b-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:40:15.055242 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:15.055205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:15.169803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:15.169766    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:40:15.174006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:15.173984    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-bfc5af-openshift-default-5468d54994-fztpd"]
Sep 11 13:40:15.901640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:15.901608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:16.000476 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:16.000441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:16.111766 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:16.111735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:16.502388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:16.502356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:16.600132 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:16.600103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:16.853152 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:16.853126    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" path="/var/lib/kubelet/pods/6e128f8f-10f5-4027-a6fe-3c0e80fe509b/volumes"
Sep 11 13:40:21.601770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:21.601731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:21.678974 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:21.678922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:21.926276 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:21.926175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:22.319678 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:22.319625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:22.490735 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:22.490702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:22.599807 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:22.599721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:28.764398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:28.764355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:28.873399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:28.873366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:28.919904 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:28.919870    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:41400->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Sep 11 13:40:28.920048 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:28.919944    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:41400->10.134.0.49:15021: read: connection reset by peer"
Sep 11 13:40:28.972869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:28.972841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:29.172565 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.172476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:29.941719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.941688    2582 generic.go:356] "Generic (PLEG): container finished" podID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerID="7d687d5d0a346855c984d94d1598178fc5006ed8a90e7e73e3e43891ad6eec88" exitCode=0
Sep 11 13:40:29.942115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.941757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerDied","Data":"7d687d5d0a346855c984d94d1598178fc5006ed8a90e7e73e3e43891ad6eec88"}
Sep 11 13:40:29.942191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.942128    2582 scope.go:117] "RemoveContainer" containerID="7d687d5d0a346855c984d94d1598178fc5006ed8a90e7e73e3e43891ad6eec88"
Sep 11 13:40:29.943201 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.943168    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:29.943304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.943267    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:29.943359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:29.943313    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:30.948632 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:30.948595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerStarted","Data":"c62ab05a6ecf85488598f2db48e267b6b40b93e0588bc6b747ad07448285733b"}
Sep 11 13:40:31.840563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:31.840524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:31.840737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:31.840671    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:40:31.840737 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:31.840723    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:40:32.840466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:32.840435    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:40:32.840839 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:32.840488    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:40:33.839960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:33.839926    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:40:33.840133 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:33.839979    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:40:34.840120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:34.840085    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:40:34.840528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:34.840146    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:40:35.448684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:35.448648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:35.537692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:35.537660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:35.840330 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:35.840293    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 13:40:35.840744 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:35.840347    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 13:40:36.504040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.504006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:36.833297 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.833261    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:40:36.834005 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.833983    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.834070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.834010    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.834070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.834052    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.834070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.834062    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.834175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.834159    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.834212 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.834175    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e128f8f-10f5-4027-a6fe-3c0e80fe509b" containerName="istio-proxy"
Sep 11 13:40:36.837895 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.837877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.840362 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.840342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-7bfa93-openshift-default-dockercfg-xlf8q\""
Sep 11 13:40:36.844375 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.844355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:36.844746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.844729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:36.845738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.845401    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:40:36.854084 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.854064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:40:36.874335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.874302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:36.900145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900408 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kd6v\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900408 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:36.900816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:36.900791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kd6v\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.002805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.002765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.003030 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.003006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.003191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.003014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.003191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.003184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.004595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.004574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.004843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.004825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.010986 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.010955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.011298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.011278    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kd6v\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v\") pod \"e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") " pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.150293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.150221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:37.215324 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.215282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:37.436426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.436339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:40:37.439706 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:40:37.439675    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22b1f2f_708f_4cfc_804a_09e5b989da18.slice/crio-308a2f14fada46553cea9813cee5335f2caec6e8f511dab9e9efbbfc78586007 WatchSource:0}: Error finding container 308a2f14fada46553cea9813cee5335f2caec6e8f511dab9e9efbbfc78586007: Status 404 returned error can't find the container with id 308a2f14fada46553cea9813cee5335f2caec6e8f511dab9e9efbbfc78586007
Sep 11 13:40:37.442311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.442275    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:37.442427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.442356    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:37.442427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.442401    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:37.998224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.998165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerStarted","Data":"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"}
Sep 11 13:40:37.998720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:37.998245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerStarted","Data":"308a2f14fada46553cea9813cee5335f2caec6e8f511dab9e9efbbfc78586007"}
Sep 11 13:40:38.029828 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:38.029779    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podStartSLOduration=2.02976233 podStartE2EDuration="2.02976233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:38.028431757 +0000 UTC m=+1251.860866895" watchObservedRunningTime="2026-09-11 13:40:38.02976233 +0000 UTC m=+1251.862197490"
Sep 11 13:40:38.151342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:38.151305    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:38.157484 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:38.157459    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:38.475638 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:38.475610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:38.945045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:38.944997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:39.003998 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.003958    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:39.004774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.004753    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:39.363856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.363820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:39.519696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.519661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:39.724293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.724219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:39.897442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:39.897410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:40.069343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:40.069310    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:40.191851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:40.191816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:40.897385 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:40.897357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:42.051795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:42.051763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:42.179427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:42.179395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:42.416451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:42.416361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:42.817064 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:42.817031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:42.916339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:42.916304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:43.449307 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:43.449271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:43.561543 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:43.561488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:44.904575 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:44.904540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:45.877220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:45.877185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:47.056532 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:47.056484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:47.158185 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:47.158130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:47.511905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:47.511822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:47.616449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:47.616411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:47.719108 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:47.719078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:40:55.044648 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:55.044609    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:40:55.045035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:55.044692    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:40:56.109410 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.109376    2582 generic.go:356] "Generic (PLEG): container finished" podID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerID="154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05" exitCode=0
Sep 11 13:40:56.109963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.109424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerDied","Data":"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"}
Sep 11 13:40:56.109963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.109950    2582 scope.go:117] "RemoveContainer" containerID="154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"
Sep 11 13:40:56.111221 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.111192    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:56.111312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.111296    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:56.111350 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:56.111342    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:40:57.116171 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:57.116133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerStarted","Data":"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"}
Sep 11 13:40:57.150653 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:57.150621    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:40:57.150825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:57.150801    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 13:40:57.150897 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:57.150858    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 13:40:58.151251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:58.151216    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 13:40:58.151639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:58.151274    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 13:40:59.150682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:59.150636    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 13:40:59.150901 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:40:59.150750    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 13:41:00.151467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:00.151427    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 13:41:00.151860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:00.151490    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 13:41:01.150896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:01.150859    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 13:41:01.151075 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:01.150914    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 13:41:02.154930 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:02.154901    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:41:02.155300 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:02.155158    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:41:02.155883 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:02.155863    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:41:03.475431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:03.475393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:04.971125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:04.971097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:05.182390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.182355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:05.557695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.557661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:05.716645 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.716615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:05.925853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.925761    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:41:05.930345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.930321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:05.932905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.932882    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-32b673-openshift-default-dockercfg-wj86w\""
Sep 11 13:41:05.946598 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.946561    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:41:05.965446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:05.965416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:06.097400 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.097831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.098069 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097843    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npmhr\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.098069 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.097885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npmhr\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.198983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.198850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.199305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.199072    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.199305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.199122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.199305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.199187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.199305 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.199256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.199680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.199658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.201249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.201228    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.201415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.201399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.207546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.207519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npmhr\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.208182 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.208164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token\") pod \"e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") " pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.241311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.241288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:06.482366 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.482267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:06.522162 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.522134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:41:06.522949 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:41:06.522919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b8c389_1bad_4588_a8f0_d8cce744e970.slice/crio-50a6d70e2ce4f7fc2556ab5edca0cb6cd3fe2c2746ad6aa520825c5860238826 WatchSource:0}: Error finding container 50a6d70e2ce4f7fc2556ab5edca0cb6cd3fe2c2746ad6aa520825c5860238826: Status 404 returned error can't find the container with id 50a6d70e2ce4f7fc2556ab5edca0cb6cd3fe2c2746ad6aa520825c5860238826
Sep 11 13:41:06.525351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.525321    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:06.525429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.525384    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:06.525429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.525412    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:06.592254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:06.592219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:07.167919 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.167887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerStarted","Data":"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"}
Sep 11 13:41:07.168295 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.167945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerStarted","Data":"50a6d70e2ce4f7fc2556ab5edca0cb6cd3fe2c2746ad6aa520825c5860238826"}
Sep 11 13:41:07.197771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.197711    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podStartSLOduration=2.19768937 podStartE2EDuration="2.19768937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:07.195113108 +0000 UTC m=+1281.027548249" watchObservedRunningTime="2026-09-11 13:41:07.19768937 +0000 UTC m=+1281.030124510"
Sep 11 13:41:07.242076 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.242040    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:07.249017 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.248987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:07.452060 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:07.451979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:08.174185 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:08.174150    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:08.175188 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:08.175172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:08.381932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:08.381901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:08.661183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:08.661150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:09.266384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:09.266341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:09.410398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:09.410367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:09.877232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:09.877200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:10.782495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:10.782460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:11.766517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:11.766479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:11.866033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:11.866000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:12.286878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:12.286850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:12.386793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:12.386759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:12.766573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:12.766468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:13.557355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:13.557317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:14.393461 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:14.393430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:21.415647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.415603    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:41:21.419428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.419407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.421800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.421776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"kube-root-ca.crt\""
Sep 11 13:41:21.422695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.422678    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"auth-test-model-3dd80c-kserve-self-signed-certs\""
Sep 11 13:41:21.422777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.422708    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"openshift-service-ca.crt\""
Sep 11 13:41:21.422777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.422722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"default-dockercfg-6qs9k\""
Sep 11 13:41:21.429962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.429938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:41:21.454336 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.454436 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.454436 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbg45\" (UniqueName: \"kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.454569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.454569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.454569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.454552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbg45\" (UniqueName: \"kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555956 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.555993 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.555952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.557754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.557733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.557937 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.557920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.564209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.564185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbg45\" (UniqueName: \"kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45\") pod \"auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:21.612805 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.612767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:21.741577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:21.741475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:22.049556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:22.049529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:41:22.051389 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:41:22.051358    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57b171da_f4af_4751_adb2_a80acb13bb21.slice/crio-6ed87fb9b0066d936271420b642b500cf7c96e54c2347f4a99eee3407bf692b4 WatchSource:0}: Error finding container 6ed87fb9b0066d936271420b642b500cf7c96e54c2347f4a99eee3407bf692b4: Status 404 returned error can't find the container with id 6ed87fb9b0066d936271420b642b500cf7c96e54c2347f4a99eee3407bf692b4
Sep 11 13:41:22.247038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:22.247001    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" event={"ID":"57b171da-f4af-4751-adb2-a80acb13bb21","Type":"ContainerStarted","Data":"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"}
Sep 11 13:41:22.247195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:22.247046    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" event={"ID":"57b171da-f4af-4751-adb2-a80acb13bb21","Type":"ContainerStarted","Data":"6ed87fb9b0066d936271420b642b500cf7c96e54c2347f4a99eee3407bf692b4"}
Sep 11 13:41:28.280870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.280837    2582 generic.go:356] "Generic (PLEG): container finished" podID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerID="faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85" exitCode=0
Sep 11 13:41:28.281285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.280903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerDied","Data":"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"}
Sep 11 13:41:28.281336 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.281312    2582 scope.go:117] "RemoveContainer" containerID="faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"
Sep 11 13:41:28.282423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.282396    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:28.282492 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.282461    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:28.282566 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.282492    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:28.309700 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:28.309653    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" podStartSLOduration=7.309636941 podStartE2EDuration="7.309636941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:22.27466812 +0000 UTC m=+1296.107103260" watchObservedRunningTime="2026-09-11 13:41:28.309636941 +0000 UTC m=+1302.142072080"
Sep 11 13:41:29.295005 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:29.294959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerStarted","Data":"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"}
Sep 11 13:41:30.242353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:30.242317    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:30.242723 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:30.242698    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 13:41:30.242784 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:30.242753    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 13:41:31.242188 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:31.242146    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 13:41:31.242662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:31.242206    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 13:41:31.741911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:31.741863    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:31.742134 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:31.741950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:31.754343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:31.754321    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:32.241999 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:32.241966    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 13:41:32.242173 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:32.242022    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 13:41:32.321859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:32.321830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:41:33.241858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:33.241821    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 13:41:33.242033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:33.241880    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 13:41:34.242427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:34.242391    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 13:41:34.242842 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:34.242459    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 13:41:34.273748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:34.273713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:34.377328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:34.377284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:35.088249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.088212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:35.245859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.245829    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:35.246291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.246114    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:35.246866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.246847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:41:35.718950 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.718914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:35.987483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:35.987401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:36.985255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:36.985215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:37.740806 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:37.740772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:43.889600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:43.889562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:44.168951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.168863    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:41:44.172354 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.172333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.174874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.174852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ceb67528-openshift-default-dockercfg-wj7kv\""
Sep 11 13:41:44.185070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.185048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:41:44.201120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.201095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:44.298569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.298536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:44.307245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307362 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307362 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.307825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.307684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshst\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409126 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wshst\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.409951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.409924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.410234 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.410214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.411652 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.411631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.411853 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.411837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.417003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.416982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.417291 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.417275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshst\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst\") pod \"e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") " pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.484405 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.484314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:44.760916 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.760888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:41:44.762624 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:41:44.762597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9b335c_794f_4f47_aa87_ffe5893eebe0.slice/crio-3509edbc8251cbb8de6006f1af63a3c03eae9e5b306359c3990a403b16c32dd4 WatchSource:0}: Error finding container 3509edbc8251cbb8de6006f1af63a3c03eae9e5b306359c3990a403b16c32dd4: Status 404 returned error can't find the container with id 3509edbc8251cbb8de6006f1af63a3c03eae9e5b306359c3990a403b16c32dd4
Sep 11 13:41:44.765012 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.764980    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:44.765125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.765050    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:44.765125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:44.765076    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:41:45.379525 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:45.379472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerStarted","Data":"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"}
Sep 11 13:41:45.379913 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:45.379543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerStarted","Data":"3509edbc8251cbb8de6006f1af63a3c03eae9e5b306359c3990a403b16c32dd4"}
Sep 11 13:41:45.435970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:45.435921    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podStartSLOduration=1.435906741 podStartE2EDuration="1.435906741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:45.434037695 +0000 UTC m=+1319.266480084" watchObservedRunningTime="2026-09-11 13:41:45.435906741 +0000 UTC m=+1319.268341880"
Sep 11 13:41:45.485317 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:45.485286    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:45.490396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:45.490373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:46.384652 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:46.384613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:46.385546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:46.385521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:41:46.692419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:46.692342    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:47.473834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:47.473798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:47.594468 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:47.594428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:47.709708 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:47.709674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:48.667989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:48.667956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:49.689343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:49.689312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:50.587422 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:50.587392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:51.415755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:51.415722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:51.535469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:51.535444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:51.635980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:51.635946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:52.076262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:52.076233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:52.191396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:52.191361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:41:59.936260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:41:59.936225    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:00.592874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.592831    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:42:00.597066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.597037    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.599370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.599343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"kube-root-ca.crt\""
Sep 11 13:42:00.600362 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.600328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"auth-test-model-d6ca2b-kserve-self-signed-certs\""
Sep 11 13:42:00.600362 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.600357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"default-dockercfg-r4bl2\""
Sep 11 13:42:00.600557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.600357    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"openshift-service-ca.crt\""
Sep 11 13:42:00.604747 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.604721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:42:00.688570 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.688535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxjpr\" (UniqueName: \"kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.688873 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.688846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.689097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.689079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.689286 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.689270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.689480 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.689465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.689665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.689648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.790514 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.790458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.790773 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.790751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.790944 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.790927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjpr\" (UniqueName: \"kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.791055 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.791228 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.791454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.791690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.791911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791728    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.792056 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.791970    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.794748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.794721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.795267 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.795246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.799962 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.799945    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxjpr\" (UniqueName: \"kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr\") pod \"auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.908905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.908826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:00.912309 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:00.912275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:01.183479 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:01.183429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:42:01.478204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:01.478107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" event={"ID":"99395fbd-734b-47e4-834a-d5022cee2c4e","Type":"ContainerStarted","Data":"c9446e6b01eb459bfb18ebc9323a76f03e3a69374870846783c5b0c8ee3237d7"}
Sep 11 13:42:01.478449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:01.478426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" event={"ID":"99395fbd-734b-47e4-834a-d5022cee2c4e","Type":"ContainerStarted","Data":"e07f4dd25ec1bf0fafe1a0886313c704f8350bc479f1e42c29ed144700175c53"}
Sep 11 13:42:01.503862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:01.503810    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" podStartSLOduration=1.503796274 podStartE2EDuration="1.503796274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:42:01.50234396 +0000 UTC m=+1335.334779100" watchObservedRunningTime="2026-09-11 13:42:01.503796274 +0000 UTC m=+1335.336231412"
Sep 11 13:42:08.530885 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.530853    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerID="5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d" exitCode=0
Sep 11 13:42:08.531391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.530930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerDied","Data":"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"}
Sep 11 13:42:08.531485 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.531465    2582 scope.go:117] "RemoveContainer" containerID="5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"
Sep 11 13:42:08.532658 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.532632    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:42:08.532721 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.532696    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:42:08.532764 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:08.532731    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:42:09.538224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:09.538135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerStarted","Data":"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"}
Sep 11 13:42:10.486191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.485759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:42:10.486191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.485892    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:42:10.486191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.485936    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 13:42:10.908981 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.908942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:10.909475 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.909000    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:10.924869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:10.924843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:11.485278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:11.485241    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:42:11.485602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:11.485570    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 13:42:11.559940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:11.559907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:42:12.485050 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:12.485012    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:42:12.485637 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:12.485605    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 13:42:13.485236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:13.485190    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:42:13.485738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:13.485258    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 13:42:13.860322 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:13.860269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:14.485602 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:14.485561    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:42:14.486107 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:14.485638    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 13:42:15.488984 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:15.488954    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:42:15.489361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:15.489329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:42:15.490045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:15.490018    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:42:15.688240 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:15.688209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:16.584277 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:16.584241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:17.508353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:17.508303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:17.628555 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:17.628492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:18.677249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:18.677210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:19.514844 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:19.514807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:20.677944 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:20.677910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:44.808568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.808532    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:42:44.811841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.811823    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.815238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.815217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ceb67528\"/\"kube-root-ca.crt\""
Sep 11 13:42:44.815364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.815258    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ceb67528\"/\"openshift-service-ca.crt\""
Sep 11 13:42:44.815364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.815219    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ceb67528\"/\"default-dockercfg-vbpmn\""
Sep 11 13:42:44.815364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.815218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ceb67528\"/\"e2e-lifecycle-model-ceb67528-kserve-self-signed-certs\""
Sep 11 13:42:44.824030 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.824004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:42:44.938209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.938359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.938359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.938455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6mq\" (UniqueName: \"kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.938455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:44.938455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:44.938450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.004971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.004939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:42:45.039266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6mq\" (UniqueName: \"kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039740 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039798 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.039920 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.039899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.041288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.041262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.041794 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.041772    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.047831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.047807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6mq\" (UniqueName: \"kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq\") pod \"e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") " pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.121749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.121691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:45.393729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.393701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:42:45.396711 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:42:45.396663    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode98a2f11_0a1f_4c35_8319_d894fa4e81c5.slice/crio-50c08b9b79965d79e49c66032844d00fc869a12f509ab174a58a0ca72ad8b0f3 WatchSource:0}: Error finding container 50c08b9b79965d79e49c66032844d00fc869a12f509ab174a58a0ca72ad8b0f3: Status 404 returned error can't find the container with id 50c08b9b79965d79e49c66032844d00fc869a12f509ab174a58a0ca72ad8b0f3
Sep 11 13:42:45.752467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.752387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" event={"ID":"e98a2f11-0a1f-4c35-8319-d894fa4e81c5","Type":"ContainerStarted","Data":"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"}
Sep 11 13:42:45.752467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.752428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" event={"ID":"e98a2f11-0a1f-4c35-8319-d894fa4e81c5","Type":"ContainerStarted","Data":"50c08b9b79965d79e49c66032844d00fc869a12f509ab174a58a0ca72ad8b0f3"}
Sep 11 13:42:45.772048 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:45.771997    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" podStartSLOduration=1.771982141 podStartE2EDuration="1.771982141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:42:45.769995541 +0000 UTC m=+1379.602430680" watchObservedRunningTime="2026-09-11 13:42:45.771982141 +0000 UTC m=+1379.604417279"
Sep 11 13:42:55.122441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:55.122411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:55.122863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:55.122461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:55.135075 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:55.135053    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:42:55.833035 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:42:55.832992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:43:00.163160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:00.163112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:13.686455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:13.686413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:14.952245 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:14.952212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:15.844855 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:15.844820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:16.807017 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:16.806973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:17.830194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:17.830155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:18.758490 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:18.758455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.142803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.142774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.254980 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.254944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.382371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.382335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.498886 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.498786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.588298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.588267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:29.933825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:29.933768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:30.846842 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:30.846792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:31.744466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:31.744413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:32.680735 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:32.680691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:32.924758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:32.924722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:33.700474 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:33.700439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:37.797209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:37.797176    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:43:37.898460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:37.898430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:43:52.816742 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:52.816630    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" podUID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" containerName="main" containerID="cri-o://138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6" gracePeriod=45
Sep 11 13:43:53.064961 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.064939    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:43:53.130728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.130644    2582 generic.go:356] "Generic (PLEG): container finished" podID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" containerID="138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6" exitCode=0
Sep 11 13:43:53.130728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.130705    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" event={"ID":"e98a2f11-0a1f-4c35-8319-d894fa4e81c5","Type":"ContainerDied","Data":"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"}
Sep 11 13:43:53.130958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.130728    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"
Sep 11 13:43:53.130958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.130743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864" event={"ID":"e98a2f11-0a1f-4c35-8319-d894fa4e81c5","Type":"ContainerDied","Data":"50c08b9b79965d79e49c66032844d00fc869a12f509ab174a58a0ca72ad8b0f3"}
Sep 11 13:43:53.130958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.130765    2582 scope.go:117] "RemoveContainer" containerID="138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"
Sep 11 13:43:53.141612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.141581    2582 scope.go:117] "RemoveContainer" containerID="138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"
Sep 11 13:43:53.141923 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:43:53.141896    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6\": container with ID starting with 138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6 not found: ID does not exist" containerID="138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"
Sep 11 13:43:53.142001 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.141935    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6"} err="failed to get container status \"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6\": rpc error: code = NotFound desc = could not find container \"138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6\": container with ID starting with 138d616a995549b56995f7c430c1ca6f2b8897cf4b60139cca874a4856fb9bb6 not found: ID does not exist"
Sep 11 13:43:53.220003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.219976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220061    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220221 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt6mq\" (UniqueName: \"kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220243    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220303 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220262    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:43:53.220377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm\") pod \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\" (UID: \"e98a2f11-0a1f-4c35-8319-d894fa4e81c5\") "
Sep 11 13:43:53.220420 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220361    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:43:53.220559 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home" (OuterVolumeSpecName: "home") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:43:53.220759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220744    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.220824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220760    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.220824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.220769    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.222391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.222369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:43:53.222490 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.222394    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm" (OuterVolumeSpecName: "dshm") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:43:53.222490 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.222411    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq" (OuterVolumeSpecName: "kube-api-access-pt6mq") pod "e98a2f11-0a1f-4c35-8319-d894fa4e81c5" (UID: "e98a2f11-0a1f-4c35-8319-d894fa4e81c5"). InnerVolumeSpecName "kube-api-access-pt6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:43:53.321356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.321325    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.321356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.321356    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt6mq\" (UniqueName: \"kubernetes.io/projected/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-kube-api-access-pt6mq\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.321527 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.321368    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e98a2f11-0a1f-4c35-8319-d894fa4e81c5-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:43:53.473444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.473403    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:43:53.483332 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:53.483304    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ceb67528/e2e-lifecycle-model-ceb67528-kserve-64bb6b9579-nd864"]
Sep 11 13:43:54.853007 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:43:54.852973    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" path="/var/lib/kubelet/pods/e98a2f11-0a1f-4c35-8319-d894fa4e81c5/volumes"
Sep 11 13:44:10.838638 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:10.838598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:11.076279 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:11.076241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:11.961929 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:11.961901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:44:11.999210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:11.999178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:13.132720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:13.132687    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:44:13.199414 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:13.199376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:15.327797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:15.327768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:16.893265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:16.893206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:23.157431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:23.157397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:25.470914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:25.470879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:26.980874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:26.980831    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" podUID="57b171da-f4af-4751-adb2-a80acb13bb21" containerName="main" containerID="cri-o://6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90" gracePeriod=45
Sep 11 13:44:27.232149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.232086    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:44:27.280128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280091    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280213    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280438 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280396    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:27.280495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280472    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache" (OuterVolumeSpecName: "model-cache") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:27.280610 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280587    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280652 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280787 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280765    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbg45\" (UniqueName: \"kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45\") pod \"57b171da-f4af-4751-adb2-a80acb13bb21\" (UID: \"57b171da-f4af-4751-adb2-a80acb13bb21\") "
Sep 11 13:44:27.280924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.280898    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home" (OuterVolumeSpecName: "home") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:27.281202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.281180    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:27.281292 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.281203    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:27.281292 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.281217    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:27.282486 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.282460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:44:27.282849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.282834    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm" (OuterVolumeSpecName: "dshm") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:27.283220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.283192    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45" (OuterVolumeSpecName: "kube-api-access-mbg45") pod "57b171da-f4af-4751-adb2-a80acb13bb21" (UID: "57b171da-f4af-4751-adb2-a80acb13bb21"). InnerVolumeSpecName "kube-api-access-mbg45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:44:27.316844 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.316819    2582 generic.go:356] "Generic (PLEG): container finished" podID="57b171da-f4af-4751-adb2-a80acb13bb21" containerID="6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90" exitCode=0
Sep 11 13:44:27.316963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.316857    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"
Sep 11 13:44:27.316963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.316903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" event={"ID":"57b171da-f4af-4751-adb2-a80acb13bb21","Type":"ContainerDied","Data":"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"}
Sep 11 13:44:27.316963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.316943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp" event={"ID":"57b171da-f4af-4751-adb2-a80acb13bb21","Type":"ContainerDied","Data":"6ed87fb9b0066d936271420b642b500cf7c96e54c2347f4a99eee3407bf692b4"}
Sep 11 13:44:27.316963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.316960    2582 scope.go:117] "RemoveContainer" containerID="6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"
Sep 11 13:44:27.325790 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.325775    2582 scope.go:117] "RemoveContainer" containerID="6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"
Sep 11 13:44:27.326077 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:44:27.326059    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90\": container with ID starting with 6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90 not found: ID does not exist" containerID="6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"
Sep 11 13:44:27.326133 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.326089    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90"} err="failed to get container status \"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90\": rpc error: code = NotFound desc = could not find container \"6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90\": container with ID starting with 6ca15b5af88145612d20ffaf775f5aba7debd9583089044c13442ff7259dff90 not found: ID does not exist"
Sep 11 13:44:27.340863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.340837    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:44:27.344544 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.344523    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/auth-test-model-3dd80c-kserve-5b98c6b6cf-wn6tp"]
Sep 11 13:44:27.382600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.382577    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b171da-f4af-4751-adb2-a80acb13bb21-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:27.382600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.382597    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbg45\" (UniqueName: \"kubernetes.io/projected/57b171da-f4af-4751-adb2-a80acb13bb21-kube-api-access-mbg45\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:27.382736 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:27.382607    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b171da-f4af-4751-adb2-a80acb13bb21-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.152816 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.152764    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" podUID="99395fbd-734b-47e4-834a-d5022cee2c4e" containerName="main" containerID="cri-o://c9446e6b01eb459bfb18ebc9323a76f03e3a69374870846783c5b0c8ee3237d7" gracePeriod=45
Sep 11 13:44:28.327850 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.327817    2582 generic.go:356] "Generic (PLEG): container finished" podID="99395fbd-734b-47e4-834a-d5022cee2c4e" containerID="c9446e6b01eb459bfb18ebc9323a76f03e3a69374870846783c5b0c8ee3237d7" exitCode=0
Sep 11 13:44:28.328000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.327848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" event={"ID":"99395fbd-734b-47e4-834a-d5022cee2c4e","Type":"ContainerDied","Data":"c9446e6b01eb459bfb18ebc9323a76f03e3a69374870846783c5b0c8ee3237d7"}
Sep 11 13:44:28.413360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.413303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:44:28.492516 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492467    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492605    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492670 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492788 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492764    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxjpr\" (UniqueName: \"kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492855 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492837    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir\") pod \"99395fbd-734b-47e4-834a-d5022cee2c4e\" (UID: \"99395fbd-734b-47e4-834a-d5022cee2c4e\") "
Sep 11 13:44:28.492903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492883    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home" (OuterVolumeSpecName: "home") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:28.492903 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.492895    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:28.493100 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.493081    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:28.493270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.493249    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.493270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.493269    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.493436 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.493280    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.494872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.494759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm" (OuterVolumeSpecName: "dshm") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:28.494872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.494827    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:44:28.494872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.494839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr" (OuterVolumeSpecName: "kube-api-access-lxjpr") pod "99395fbd-734b-47e4-834a-d5022cee2c4e" (UID: "99395fbd-734b-47e4-834a-d5022cee2c4e"). InnerVolumeSpecName "kube-api-access-lxjpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:44:28.594685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.594657    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99395fbd-734b-47e4-834a-d5022cee2c4e-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.594685 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.594683    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99395fbd-734b-47e4-834a-d5022cee2c4e-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.594823 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.594695    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxjpr\" (UniqueName: \"kubernetes.io/projected/99395fbd-734b-47e4-834a-d5022cee2c4e-kube-api-access-lxjpr\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:28.852299 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:28.852269    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b171da-f4af-4751-adb2-a80acb13bb21" path="/var/lib/kubelet/pods/57b171da-f4af-4751-adb2-a80acb13bb21/volumes"
Sep 11 13:44:29.334699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:29.334665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d" event={"ID":"99395fbd-734b-47e4-834a-d5022cee2c4e","Type":"ContainerDied","Data":"e07f4dd25ec1bf0fafe1a0886313c704f8350bc479f1e42c29ed144700175c53"}
Sep 11 13:44:29.335157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:29.334710    2582 scope.go:117] "RemoveContainer" containerID="c9446e6b01eb459bfb18ebc9323a76f03e3a69374870846783c5b0c8ee3237d7"
Sep 11 13:44:29.335157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:29.334677    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"
Sep 11 13:44:29.359255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:29.359231    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:44:29.362664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:29.362632    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/auth-test-model-d6ca2b-kserve-7b76f4dd7f-f7f6d"]
Sep 11 13:44:30.061747 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.061719    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:30.191369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.191329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:30.421534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.421432    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:44:30.421904 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.421703    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" containerID="cri-o://dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf" gracePeriod=30
Sep 11 13:44:30.491758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.491730    2582 patch_prober.go:28] interesting pod/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:44:30.491895 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.491791    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:44:30.535046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.535000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:30.853029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:30.852996    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99395fbd-734b-47e4-834a-d5022cee2c4e" path="/var/lib/kubelet/pods/99395fbd-734b-47e4-834a-d5022cee2c4e/volumes"
Sep 11 13:44:31.975310 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:31.975277    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:32.174027 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:32.173992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:32.949351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:32.949314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:33.079100 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:33.079068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:34.774390 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:34.774355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:35.682178 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.682157    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:44:35.766410 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766410 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766393    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766429    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wshst\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766453    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766491    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766712    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:35.766940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:35.766940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.766940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert\") pod \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\" (UID: \"2e9b335c-794f-4f47-aa87-ffe5893eebe0\") "
Sep 11 13:44:35.767085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.766977    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:35.767085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767035    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:35.767357 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:44:35.767441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767415    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.767441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767435    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.767535 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767453    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.767535 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.767467    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.768748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.768729    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:44:35.768892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.768839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:44:35.769144 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.769123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:44:35.769194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.769123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst" (OuterVolumeSpecName: "kube-api-access-wshst") pod "2e9b335c-794f-4f47-aa87-ffe5893eebe0" (UID: "2e9b335c-794f-4f47-aa87-ffe5893eebe0"). InnerVolumeSpecName "kube-api-access-wshst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:44:35.868359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.868329    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.868359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.868355    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.868359 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.868364    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.868809 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.868371    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wshst\" (UniqueName: \"kubernetes.io/projected/2e9b335c-794f-4f47-aa87-ffe5893eebe0-kube-api-access-wshst\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:35.868809 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:35.868382    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e9b335c-794f-4f47-aa87-ffe5893eebe0-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:44:36.372854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.372819    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerID="dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf" exitCode=0
Sep 11 13:44:36.373044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.372870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"
Sep 11 13:44:36.373044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.372905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerDied","Data":"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"}
Sep 11 13:44:36.373044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.372961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp" event={"ID":"2e9b335c-794f-4f47-aa87-ffe5893eebe0","Type":"ContainerDied","Data":"3509edbc8251cbb8de6006f1af63a3c03eae9e5b306359c3990a403b16c32dd4"}
Sep 11 13:44:36.373044 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.372992    2582 scope.go:117] "RemoveContainer" containerID="dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"
Sep 11 13:44:36.382361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.382343    2582 scope.go:117] "RemoveContainer" containerID="5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"
Sep 11 13:44:36.390395 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.390381    2582 scope.go:117] "RemoveContainer" containerID="dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"
Sep 11 13:44:36.390659 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:44:36.390642    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf\": container with ID starting with dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf not found: ID does not exist" containerID="dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"
Sep 11 13:44:36.390713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.390666    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf"} err="failed to get container status \"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf\": rpc error: code = NotFound desc = could not find container \"dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf\": container with ID starting with dac1e1868a3fc32b3591c7f27f1914aec705f3dfc8f5e68cffc380a0167a67bf not found: ID does not exist"
Sep 11 13:44:36.390713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.390681    2582 scope.go:117] "RemoveContainer" containerID="5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"
Sep 11 13:44:36.390912 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:44:36.390896    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d\": container with ID starting with 5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d not found: ID does not exist" containerID="5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"
Sep 11 13:44:36.390957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.390915    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d"} err="failed to get container status \"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d\": rpc error: code = NotFound desc = could not find container \"5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d\": container with ID starting with 5eb7e63580c68503392a637a25dc2b76d57f8104aa5713302d71b24f0a3e674d not found: ID does not exist"
Sep 11 13:44:36.405632 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.405611    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:44:36.413183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.413162    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ceb67528-openshift-default-855b5b5bd4-khsxp"]
Sep 11 13:44:36.853259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:36.853230    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" path="/var/lib/kubelet/pods/2e9b335c-794f-4f47-aa87-ffe5893eebe0/volumes"
Sep 11 13:44:40.940487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:40.940449    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:41.017376 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:41.017343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:41.747096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:41.747064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:48.675412 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:48.675361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:48.937449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:48.937361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:49.105673 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:49.105619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:52.838647 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.838618    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:44:52.839099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839085    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" containerName="main"
Sep 11 13:44:52.839145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839103    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" containerName="main"
Sep 11 13:44:52.839145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839119    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:44:52.839145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839125    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:44:52.839145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839131    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99395fbd-734b-47e4-834a-d5022cee2c4e" containerName="main"
Sep 11 13:44:52.839145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839139    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99395fbd-734b-47e4-834a-d5022cee2c4e" containerName="main"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839161    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b171da-f4af-4751-adb2-a80acb13bb21" containerName="main"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839167    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b171da-f4af-4751-adb2-a80acb13bb21" containerName="main"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839239    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839248    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99395fbd-734b-47e4-834a-d5022cee2c4e" containerName="main"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839254    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b171da-f4af-4751-adb2-a80acb13bb21" containerName="main"
Sep 11 13:44:52.839311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.839261    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e98a2f11-0a1f-4c35-8319-d894fa4e81c5" containerName="main"
Sep 11 13:44:52.842392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.842376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.845067 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.845045    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"openshift-service-ca.crt\""
Sep 11 13:44:52.845192 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.845140    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"default-dockercfg-r4bl2\""
Sep 11 13:44:52.845841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.845820    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"kube-root-ca.crt\""
Sep 11 13:44:52.845841 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.845829    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"sub-test-model-d6ca2b-kserve-self-signed-certs\""
Sep 11 13:44:52.857759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.857735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:44:52.882910 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.882883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:52.934077 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.934193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.934193 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.934290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.934290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bqjx\" (UniqueName: \"kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:52.934394 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:52.934377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035395 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035540 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bqjx\" (UniqueName: \"kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035890 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.035934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.035886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.037760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.037739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.038141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.038120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.048128 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.048099    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bqjx\" (UniqueName: \"kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx\") pod \"sub-test-model-d6ca2b-kserve-7ffb8df867-428dr\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.164059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.163988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:44:53.441963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.441930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:44:53.442790 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:44:53.442753    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc021bb26_cc92_4178_a3a6_04f9324cae8a.slice/crio-5193c638b2e15f931a097f0063878de4c64cd3812f70442ed6875326de0d53e5 WatchSource:0}: Error finding container 5193c638b2e15f931a097f0063878de4c64cd3812f70442ed6875326de0d53e5: Status 404 returned error can't find the container with id 5193c638b2e15f931a097f0063878de4c64cd3812f70442ed6875326de0d53e5
Sep 11 13:44:53.471003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:53.470976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" event={"ID":"c021bb26-cc92-4178-a3a6-04f9324cae8a","Type":"ContainerStarted","Data":"5193c638b2e15f931a097f0063878de4c64cd3812f70442ed6875326de0d53e5"}
Sep 11 13:44:54.478662 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:54.478625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" event={"ID":"c021bb26-cc92-4178-a3a6-04f9324cae8a","Type":"ContainerStarted","Data":"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"}
Sep 11 13:44:54.498572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:54.498341    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" podStartSLOduration=2.49832192 podStartE2EDuration="2.49832192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:44:54.497906202 +0000 UTC m=+1508.330341342" watchObservedRunningTime="2026-09-11 13:44:54.49832192 +0000 UTC m=+1508.330757062"
Sep 11 13:44:57.839892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:57.839847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:59.568387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:59.568354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:44:59.764541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:44:59.764494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:00.176832 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.176800    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"]
Sep 11 13:45:00.177236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.177224    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:45:00.177278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.177238    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:45:00.177328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.177319    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9b335c-794f-4f47-aa87-ffe5893eebe0" containerName="istio-proxy"
Sep 11 13:45:00.180728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.180707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"
Sep 11 13:45:00.184342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.184326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9tpvf\""
Sep 11 13:45:00.191406 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.191381    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"
Sep 11 13:45:00.199658 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.199637    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"]
Sep 11 13:45:00.202232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.202206    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"]
Sep 11 13:45:00.206951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.206926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"
Sep 11 13:45:00.226274 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.226249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"]
Sep 11 13:45:00.241434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.241410    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"
Sep 11 13:45:00.493469 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.493445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"]
Sep 11 13:45:00.495835 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:45:00.495803    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff6ed21_5341_4be5_9b39_d54423045fa1.slice/crio-90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66 WatchSource:0}: Error finding container 90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66: Status 404 returned error can't find the container with id 90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66
Sep 11 13:45:00.498151 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.498133    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:45:00.511438 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.511415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl" event={"ID":"cff6ed21-5341-4be5-9b39-d54423045fa1","Type":"ContainerStarted","Data":"90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66"}
Sep 11 13:45:00.534909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:00.534889    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"]
Sep 11 13:45:00.536987 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:45:00.536960    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c622c5_f9a8_485a_92e8_fd9b16cea378.slice/crio-c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5 WatchSource:0}: Error finding container c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5: Status 404 returned error can't find the container with id c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5
Sep 11 13:45:01.521099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:01.521057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8" event={"ID":"77c622c5-f9a8-485a-92e8-fd9b16cea378","Type":"ContainerStarted","Data":"c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5"}
Sep 11 13:45:03.164365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.164331    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:45:03.164736 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.164384    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:45:03.179057 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.179030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:45:03.534345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.534310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl" event={"ID":"cff6ed21-5341-4be5-9b39-d54423045fa1","Type":"ContainerStarted","Data":"7242adf6e7c8c22f3efdeb4a01f4e4d88de706ffa6f394d59cdefaa038027ed4"}
Sep 11 13:45:03.535884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.535856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8" event={"ID":"77c622c5-f9a8-485a-92e8-fd9b16cea378","Type":"ContainerStarted","Data":"4414aa0021d2564d419e93d80ef5a0851fdabc2647aff6662aec774ab25a20b0"}
Sep 11 13:45:03.547238 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.547218    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:45:03.562175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.562132    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl" podStartSLOduration=1.218252455 podStartE2EDuration="3.56211853s" totalImagesPullingTime="2.343866075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:03.561750963 +0000 UTC m=+1517.394186103" watchObservedRunningTime="2026-09-11 13:45:03.56211853 +0000 UTC m=+1517.394553670"
Sep 11 13:45:03.635337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:03.635282    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8" podStartSLOduration=1.33688459 podStartE2EDuration="3.635255884s" totalImagesPullingTime="2.298371294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:03.634069008 +0000 UTC m=+1517.466504148" watchObservedRunningTime="2026-09-11 13:45:03.635255884 +0000 UTC m=+1517.467691029"
Sep 11 13:45:04.543109 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:04.543073    2582 generic.go:356] "Generic (PLEG): container finished" podID="77c622c5-f9a8-485a-92e8-fd9b16cea378" containerID="4414aa0021d2564d419e93d80ef5a0851fdabc2647aff6662aec774ab25a20b0" exitCode=0
Sep 11 13:45:04.543591 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:04.543165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8" event={"ID":"77c622c5-f9a8-485a-92e8-fd9b16cea378","Type":"ContainerDied","Data":"4414aa0021d2564d419e93d80ef5a0851fdabc2647aff6662aec774ab25a20b0"}
Sep 11 13:45:04.544684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:04.544663    2582 generic.go:356] "Generic (PLEG): container finished" podID="cff6ed21-5341-4be5-9b39-d54423045fa1" containerID="7242adf6e7c8c22f3efdeb4a01f4e4d88de706ffa6f394d59cdefaa038027ed4" exitCode=0
Sep 11 13:45:04.544791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:04.544742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl" event={"ID":"cff6ed21-5341-4be5-9b39-d54423045fa1","Type":"ContainerDied","Data":"7242adf6e7c8c22f3efdeb4a01f4e4d88de706ffa6f394d59cdefaa038027ed4"}
Sep 11 13:45:05.685908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:05.685879    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"
Sep 11 13:45:05.722925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:05.722893    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"
Sep 11 13:45:06.559306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.559275    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"
Sep 11 13:45:06.559516 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.559319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8" event={"ID":"77c622c5-f9a8-485a-92e8-fd9b16cea378","Type":"ContainerDied","Data":"c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5"}
Sep 11 13:45:06.559516 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.559372    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4f60788f873229f7de471cadca2c645262a3a02861309175397fcfd5a5b88a5"
Sep 11 13:45:06.560732 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.560711    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl"
Sep 11 13:45:06.560858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.560711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818905-zsgdl" event={"ID":"cff6ed21-5341-4be5-9b39-d54423045fa1","Type":"ContainerDied","Data":"90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66"}
Sep 11 13:45:06.560858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:06.560841    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90c75a33f9922027c335b1eba0486cb7a9903836a725fa14143e5096bf397d66"
Sep 11 13:45:20.813854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:20.813771    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:27.607639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:27.607602    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:27.719073 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:27.719046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:28.017944 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.017862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:28.572911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.572877    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:45:28.573398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573378    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c622c5-f9a8-485a-92e8-fd9b16cea378" containerName="cleanup"
Sep 11 13:45:28.573398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573398    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c622c5-f9a8-485a-92e8-fd9b16cea378" containerName="cleanup"
Sep 11 13:45:28.573582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573409    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff6ed21-5341-4be5-9b39-d54423045fa1" containerName="cleanup"
Sep 11 13:45:28.573582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573416    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff6ed21-5341-4be5-9b39-d54423045fa1" containerName="cleanup"
Sep 11 13:45:28.573582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573552    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c622c5-f9a8-485a-92e8-fd9b16cea378" containerName="cleanup"
Sep 11 13:45:28.573582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.573569    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff6ed21-5341-4be5-9b39-d54423045fa1" containerName="cleanup"
Sep 11 13:45:28.584665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.584637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.587368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.587343    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-65a9ed-openshift-default-dockercfg-fxhx2\""
Sep 11 13:45:28.607098 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.607071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:45:28.693202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.693154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:28.699183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh92c\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699511 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699566 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.699664 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.699649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh92c\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801881 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801881 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801881 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.801881 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.801876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.802215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.802187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.802324 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.802273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.802478 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.802457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.803908 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.803887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.804046 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.804028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.818011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.817985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.822873 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.822854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh92c\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c\") pod \"e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") " pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:28.896189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:28.896128    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:29.059071 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.059043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:29.198592 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.198569    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:45:29.201070 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:45:29.201045    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bb3161_33bf_4395_a36a_c22657064eb4.slice/crio-f05812a7c0ca9d32968d54231149f1b5b0d71cc2c6e824b3be441bd2402b0580 WatchSource:0}: Error finding container f05812a7c0ca9d32968d54231149f1b5b0d71cc2c6e824b3be441bd2402b0580: Status 404 returned error can't find the container with id f05812a7c0ca9d32968d54231149f1b5b0d71cc2c6e824b3be441bd2402b0580
Sep 11 13:45:29.203580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.203546    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:29.203676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.203617    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:29.203676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.203648    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:29.688308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.688275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerStarted","Data":"a29b11c4ce37763441e50208fc52874d482c7c9306ec2412b25fa434c2bfa8f0"}
Sep 11 13:45:29.688528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.688330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerStarted","Data":"f05812a7c0ca9d32968d54231149f1b5b0d71cc2c6e824b3be441bd2402b0580"}
Sep 11 13:45:29.714189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.714144    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podStartSLOduration=1.714128 podStartE2EDuration="1.714128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:29.713009092 +0000 UTC m=+1543.545444231" watchObservedRunningTime="2026-09-11 13:45:29.714128 +0000 UTC m=+1543.546563138"
Sep 11 13:45:29.897194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:29.897161    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:30.902482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:30.902447    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:31.699565 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:31.699536    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:31.700522 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:31.700488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:32.765597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:32.765565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:32.995774 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:32.995740    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:33.433374 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:33.433342    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:34.930394 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:34.930337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:35.939612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:35.939576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:36.992351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:36.992311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:37.083798 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:37.083764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:37.184353 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:37.184322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:37.583427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:37.583397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:37.678396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:37.678362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:38.189195 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:38.189165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:39.166625 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:39.166592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:44.491854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:44.491824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:45.544269 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:45.544233    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:45:45.596270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:45.596222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:53.836688 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.836648    2582 generic.go:356] "Generic (PLEG): container finished" podID="61bb3161-33bf-4395-a36a-c22657064eb4" containerID="a29b11c4ce37763441e50208fc52874d482c7c9306ec2412b25fa434c2bfa8f0" exitCode=0
Sep 11 13:45:53.837127 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.836704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerDied","Data":"a29b11c4ce37763441e50208fc52874d482c7c9306ec2412b25fa434c2bfa8f0"}
Sep 11 13:45:53.837184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.837134    2582 scope.go:117] "RemoveContainer" containerID="a29b11c4ce37763441e50208fc52874d482c7c9306ec2412b25fa434c2bfa8f0"
Sep 11 13:45:53.838346 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.838320    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:53.838421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.838389    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:53.838421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:53.838417    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:45:54.844022 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:54.843986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerStarted","Data":"f4d8aa8ce70834e25229058afd9f60c6b52dba190191e2f7c80dc1a32bc074d9"}
Sep 11 13:45:54.896355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:54.896278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:45:54.896951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:54.896635    2582 patch_prober.go:28] interesting pod/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 13:45:54.896951 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:54.896702    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 13:45:55.896970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:55.896934    2582 patch_prober.go:28] interesting pod/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 13:45:55.897351 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:55.896991    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 13:45:56.896974 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:56.896935    2582 patch_prober.go:28] interesting pod/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 13:45:56.897369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:56.897000    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 13:45:57.897038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:57.896998    2582 patch_prober.go:28] interesting pod/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 13:45:57.897429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:57.897062    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 13:45:58.896851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:58.896808    2582 patch_prober.go:28] interesting pod/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 13:45:58.897154 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:58.897123    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 13:45:59.400770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.400736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:45:59.404285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.404268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.407541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.407516    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"openshift-service-ca.crt\""
Sep 11 13:45:59.407676 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.407569    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"default-dockercfg-6qs9k\""
Sep 11 13:45:59.408060 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.408043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"kube-root-ca.crt\""
Sep 11 13:45:59.408156 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.408134    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3dd80c\"/\"rate-test-model-3dd80c-kserve-self-signed-certs\""
Sep 11 13:45:59.458309 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.458280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:45:59.459409 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.459497 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.459497 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.459629 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.459695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.459758 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.459737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv86q\" (UniqueName: \"kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.514472 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.514433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:45:59.560743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.560936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.560936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.560936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.560936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.560936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.560930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv86q\" (UniqueName: \"kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.561216 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.561193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.561277 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.561228    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.561319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.561279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.563120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.563090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.563401 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.563384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.582649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.582616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv86q\" (UniqueName: \"kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q\") pod \"rate-test-model-3dd80c-kserve-7cfbccf675-55sqp\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") " pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:45:59.713584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:45:59.713471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:46:00.001667 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:46:00.001639    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eba609e_e1d3_4cc4_a31c_95d9438ebc62.slice/crio-ae06e4bc0d24df97f644c20ddb9221393b0aad25eb366e5d50a85d2f76d230e0 WatchSource:0}: Error finding container ae06e4bc0d24df97f644c20ddb9221393b0aad25eb366e5d50a85d2f76d230e0: Status 404 returned error can't find the container with id ae06e4bc0d24df97f644c20ddb9221393b0aad25eb366e5d50a85d2f76d230e0
Sep 11 13:46:00.001976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.001930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:46:00.113017 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.112981    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:46:00.113387 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.113358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:46:00.115078 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.115056    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:46:00.408125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.408075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:00.563090 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.563047    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" podUID="c021bb26-cc92-4178-a3a6-04f9324cae8a" containerName="main" containerID="cri-o://a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900" gracePeriod=45
Sep 11 13:46:00.820080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.820055    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:46:00.875709 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875678    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bqjx\" (UniqueName: \"kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.875911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.875911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.876040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.876040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875948    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.876040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.875978    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir\") pod \"c021bb26-cc92-4178-a3a6-04f9324cae8a\" (UID: \"c021bb26-cc92-4178-a3a6-04f9324cae8a\") "
Sep 11 13:46:00.876215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.876039    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:46:00.876275 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.876206    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home" (OuterVolumeSpecName: "home") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:46:00.876446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.876425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:46:00.876628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.876450    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:00.876628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.876470    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:00.878220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.878178    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm" (OuterVolumeSpecName: "dshm") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:46:00.878431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.878405    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx" (OuterVolumeSpecName: "kube-api-access-6bqjx") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "kube-api-access-6bqjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:46:00.878431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.878423    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c021bb26-cc92-4178-a3a6-04f9324cae8a" (UID: "c021bb26-cc92-4178-a3a6-04f9324cae8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:46:00.879244 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.879215    2582 generic.go:356] "Generic (PLEG): container finished" podID="c021bb26-cc92-4178-a3a6-04f9324cae8a" containerID="a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900" exitCode=0
Sep 11 13:46:00.879347 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.879291    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"
Sep 11 13:46:00.879347 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.879316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" event={"ID":"c021bb26-cc92-4178-a3a6-04f9324cae8a","Type":"ContainerDied","Data":"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"}
Sep 11 13:46:00.879453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.879364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr" event={"ID":"c021bb26-cc92-4178-a3a6-04f9324cae8a","Type":"ContainerDied","Data":"5193c638b2e15f931a097f0063878de4c64cd3812f70442ed6875326de0d53e5"}
Sep 11 13:46:00.879453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.879392    2582 scope.go:117] "RemoveContainer" containerID="a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"
Sep 11 13:46:00.881818 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.881795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" event={"ID":"1eba609e-e1d3-4cc4-a31c-95d9438ebc62","Type":"ContainerStarted","Data":"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"}
Sep 11 13:46:00.881906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.881834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" event={"ID":"1eba609e-e1d3-4cc4-a31c-95d9438ebc62","Type":"ContainerStarted","Data":"ae06e4bc0d24df97f644c20ddb9221393b0aad25eb366e5d50a85d2f76d230e0"}
Sep 11 13:46:00.893280 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.893263    2582 scope.go:117] "RemoveContainer" containerID="a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"
Sep 11 13:46:00.893587 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:00.893565    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900\": container with ID starting with a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900 not found: ID does not exist" containerID="a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"
Sep 11 13:46:00.893683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.893594    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900"} err="failed to get container status \"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900\": rpc error: code = NotFound desc = could not find container \"a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900\": container with ID starting with a342c0104fd0ef7f2581d5f94bae8a5496c598746e7f767d99206cded6694900 not found: ID does not exist"
Sep 11 13:46:00.903633 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.903589    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" podStartSLOduration=1.9035760339999999 podStartE2EDuration="1.903576034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:46:00.90099018 +0000 UTC m=+1574.733425323" watchObservedRunningTime="2026-09-11 13:46:00.903576034 +0000 UTC m=+1574.736011172"
Sep 11 13:46:00.921587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.921556    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:46:00.928760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.928734    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/sub-test-model-d6ca2b-kserve-7ffb8df867-428dr"]
Sep 11 13:46:00.978270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.978169    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:00.978270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.978195    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c021bb26-cc92-4178-a3a6-04f9324cae8a-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:00.978270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.978210    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c021bb26-cc92-4178-a3a6-04f9324cae8a-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:00.978270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:00.978224    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bqjx\" (UniqueName: \"kubernetes.io/projected/c021bb26-cc92-4178-a3a6-04f9324cae8a-kube-api-access-6bqjx\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:46:01.512750 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:01.512706    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:01.997278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:01.997232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:02.620701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:02.620668    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:02.853071 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:02.853031    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c021bb26-cc92-4178-a3a6-04f9324cae8a" path="/var/lib/kubelet/pods/c021bb26-cc92-4178-a3a6-04f9324cae8a/volumes"
Sep 11 13:46:02.874339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:02.874250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:03.119650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.119590    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:46:03.120698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.120670    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c021bb26-cc92-4178-a3a6-04f9324cae8a" containerName="main"
Sep 11 13:46:03.120866 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.120854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c021bb26-cc92-4178-a3a6-04f9324cae8a" containerName="main"
Sep 11 13:46:03.121086 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.121074    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c021bb26-cc92-4178-a3a6-04f9324cae8a" containerName="main"
Sep 11 13:46:03.126699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.126623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.136303 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.136281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ab77a5-openshift-default-dockercfg-qk8ct\""
Sep 11 13:46:03.158093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.158064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:46:03.166727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.166692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:03.202686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.202863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.202863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkvkf\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.202863 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.203040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.203040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.203040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.202974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.203319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.203049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.203319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.203093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304573 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.304858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.304744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkvkf\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.305032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.305006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.305100 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.305009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.305227 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.305200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.305356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.305279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.305356 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.305296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.306837 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.306816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.307040 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.307021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.330419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.330390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.333860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.333838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkvkf\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf\") pod \"e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") " pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.439099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.439006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:03.567526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.567474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:03.748548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.748488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:46:03.750251 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:46:03.750226    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f264e9_a90f_4eeb_9991_3acfde1bd415.slice/crio-a0a694548ef4513f123065bd91e9512a8d7790ea9bc3eaa6698e7decfd5b7fe2 WatchSource:0}: Error finding container a0a694548ef4513f123065bd91e9512a8d7790ea9bc3eaa6698e7decfd5b7fe2: Status 404 returned error can't find the container with id a0a694548ef4513f123065bd91e9512a8d7790ea9bc3eaa6698e7decfd5b7fe2
Sep 11 13:46:03.752655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.752622    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:03.752743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.752691    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:03.752743 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.752719    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:03.907118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.907059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerStarted","Data":"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"}
Sep 11 13:46:03.907277 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.907134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerStarted","Data":"a0a694548ef4513f123065bd91e9512a8d7790ea9bc3eaa6698e7decfd5b7fe2"}
Sep 11 13:46:03.981467 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:03.981408    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podStartSLOduration=0.981390076 podStartE2EDuration="981.390076ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:46:03.979200402 +0000 UTC m=+1577.811635554" watchObservedRunningTime="2026-09-11 13:46:03.981390076 +0000 UTC m=+1577.813825218"
Sep 11 13:46:04.439835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:04.439807    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:04.444651 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:04.444626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:04.913361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:04.913322    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:04.914370 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:04.914347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:05.100215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:05.100181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:06.990163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:06.990125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:07.645666 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:07.645627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:08.880989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:08.880950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:09.713872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:09.713834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:46:09.713872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:09.713883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:46:09.726393 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:09.726362    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:46:09.952835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:09.952806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:46:10.125803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:10.125769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:10.231581 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:10.231546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:10.633714 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:10.633672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:10.791118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:10.791085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:10.913895 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:10.913800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:11.516483 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:11.516450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:12.703752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:12.703720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:14.088868 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:14.088828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:15.696876 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:15.696826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:25.032762 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.032732    2582 generic.go:356] "Generic (PLEG): container finished" podID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerID="c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba" exitCode=0
Sep 11 13:46:25.033145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.032800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerDied","Data":"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"}
Sep 11 13:46:25.033213 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.033199    2582 scope.go:117] "RemoveContainer" containerID="c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"
Sep 11 13:46:25.034375 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.034346    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:25.034429 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.034415    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:25.034475 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:25.034464    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:46:26.040298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:26.040260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerStarted","Data":"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"}
Sep 11 13:46:26.440122 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:26.440036    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:26.440302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:26.440215    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:46:26.440302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:26.440279    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:46:27.439905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:27.439868    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:46:27.440307 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:27.439935    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:46:28.440031 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:28.439994    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:46:28.440434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:28.440072    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:46:29.439565 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:29.439495    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:46:29.439793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:29.439608    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:46:30.440431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:30.440389    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 13:46:30.440936 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:30.440457    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 13:46:31.443584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:31.443554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:31.443989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:31.443961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:31.444523 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:31.444487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:46:33.163070 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:33.163035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:34.170222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:34.170186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:35.609653 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:35.609615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:36.354552 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:36.354490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:36.637705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:36.637591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:37.753095 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:37.753057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:38.714373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:38.714338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:40.097111 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:40.097008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:41.033402 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:41.033370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:42.141194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:42.141162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:43.101175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:43.101144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:44.208065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.208038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:44.856001 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.855968    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:46:44.859430 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.859414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.863701 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:44.863666    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-w3-d6ca2b\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 13:46:44.863828 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:44.863702    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"rate-test-model-d6ca2b-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-w3-d6ca2b\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"rate-test-model-d6ca2b-kserve-self-signed-certs\"" type="*v1.Secret"
Sep 11 13:46:44.863828 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:44.863708    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-w3-d6ca2b\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.863828 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:44.863744    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-w3-d6ca2b\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 13:46:44.863828 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:44.863806    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-r4bl2\" is forbidden: User \"system:node:ip-10-0-132-92.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-w3-d6ca2b\": no relationship found between node 'ip-10-0-132-92.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"default-dockercfg-r4bl2\"" type="*v1.Secret"
Sep 11 13:46:44.879308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.879279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:46:44.921950 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.921917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:44.964060 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.964253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.964253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.964253 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.964427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:44.964427 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:44.964402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065150 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.065696 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.065681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.067430 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.067411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:45.337848 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.337811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:45.524149 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.524112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:45.843418 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.843388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"default-dockercfg-r4bl2\""
Sep 11 13:46:45.889640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.889609    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"rate-test-model-d6ca2b-kserve-self-signed-certs\""
Sep 11 13:46:45.898118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:45.898093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:46.078435 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:46.078401    2582 projected.go:291] Couldn't get configMap ai-tenant-e2e-shared-b-w3-d6ca2b/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:46:46.279940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.279908    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"openshift-service-ca.crt\""
Sep 11 13:46:46.289386 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:46.289363    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jp6zh for pod ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs: failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:46:46.289526 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:46:46.289432    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh podName:a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184 nodeName:}" failed. No retries permitted until 2026-09-11 13:46:46.789414357 +0000 UTC m=+1620.621849479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jp6zh" (UniqueName: "kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh") pod "rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 13:46:46.460727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.460697    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"kube-root-ca.crt\""
Sep 11 13:46:46.749622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.749522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:46.883884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.883842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:46.886281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.886262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") pod \"rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") " pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:46.971542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.971496    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6ca2b\"/\"default-dockercfg-r4bl2\""
Sep 11 13:46:46.979649 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:46.979633    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:47.298635 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:47.298608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:46:47.300738 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:46:47.300710    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9a1b5ee_a8d8_4ae4_a05a_1b6a0b12d184.slice/crio-28ec28317a1ff40dd7ca5433f4cb93b936fbf049c1e8ed18b7bed3396f5a6b31 WatchSource:0}: Error finding container 28ec28317a1ff40dd7ca5433f4cb93b936fbf049c1e8ed18b7bed3396f5a6b31: Status 404 returned error can't find the container with id 28ec28317a1ff40dd7ca5433f4cb93b936fbf049c1e8ed18b7bed3396f5a6b31
Sep 11 13:46:48.036639 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:48.036596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:48.160402 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:48.160368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" event={"ID":"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184","Type":"ContainerStarted","Data":"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"}
Sep 11 13:46:48.160604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:48.160412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" event={"ID":"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184","Type":"ContainerStarted","Data":"28ec28317a1ff40dd7ca5433f4cb93b936fbf049c1e8ed18b7bed3396f5a6b31"}
Sep 11 13:46:48.194976 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:48.194924    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" podStartSLOduration=4.194908234 podStartE2EDuration="4.194908234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:46:48.193161429 +0000 UTC m=+1622.025596571" watchObservedRunningTime="2026-09-11 13:46:48.194908234 +0000 UTC m=+1622.027343397"
Sep 11 13:46:49.793931 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:49.793894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:56.250510 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.250476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:56.415675 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.415640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:56.651418 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.651387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:56.827994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.827948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:56.979983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.979903    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:56.979983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.979957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:56.995215 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:56.995187    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:57.049800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:57.049762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:57.229095 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:57.229063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:46:57.262606 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:57.262519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:57.398383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:57.398347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:58.673442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:58.673408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:46:59.881702 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:46:59.881670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:01.120455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:01.120423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:02.408016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:02.407977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:03.856636 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:03.856584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:05.255374 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:05.255340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:05.818557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:05.818522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:05.931856 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:05.931822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:06.132325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:06.132234    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:47:06.132533 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:06.132492    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy" containerID="cri-o://f4d8aa8ce70834e25229058afd9f60c6b52dba190191e2f7c80dc1a32bc074d9" gracePeriod=30
Sep 11 13:47:06.230360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:06.230321    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:06.789006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:06.788969    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:07.943571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:07.943533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:08.937574 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:08.937536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:09.801707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:09.801658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:10.957749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:10.957687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:11.297786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.297754    2582 generic.go:356] "Generic (PLEG): container finished" podID="61bb3161-33bf-4395-a36a-c22657064eb4" containerID="f4d8aa8ce70834e25229058afd9f60c6b52dba190191e2f7c80dc1a32bc074d9" exitCode=0
Sep 11 13:47:11.297940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.297821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerDied","Data":"f4d8aa8ce70834e25229058afd9f60c6b52dba190191e2f7c80dc1a32bc074d9"}
Sep 11 13:47:11.297940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.297885    2582 scope.go:117] "RemoveContainer" containerID="a29b11c4ce37763441e50208fc52874d482c7c9306ec2412b25fa434c2bfa8f0"
Sep 11 13:47:11.391786 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.391757    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:47:11.550316 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550278    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550333    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550369    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh92c\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550429    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550618    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:11.550880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket\") pod \"61bb3161-33bf-4395-a36a-c22657064eb4\" (UID: \"61bb3161-33bf-4395-a36a-c22657064eb4\") "
Sep 11 13:47:11.550880 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.550774    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:11.551074 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551037    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:11.551157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551134    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:11.551361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551321    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.551361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551346    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.551496 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551361    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.551791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.551765    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:47:11.553009 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.552987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:11.553110 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.553041    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:11.553167 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.553144    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:47:11.553167 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.553154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c" (OuterVolumeSpecName: "kube-api-access-dh92c") pod "61bb3161-33bf-4395-a36a-c22657064eb4" (UID: "61bb3161-33bf-4395-a36a-c22657064eb4"). InnerVolumeSpecName "kube-api-access-dh92c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:11.652690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652657    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61bb3161-33bf-4395-a36a-c22657064eb4-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.652690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652684    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh92c\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-kube-api-access-dh92c\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.652690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652694    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61bb3161-33bf-4395-a36a-c22657064eb4-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.652917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652704    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61bb3161-33bf-4395-a36a-c22657064eb4-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.652917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652712    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:11.652917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:11.652720    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61bb3161-33bf-4395-a36a-c22657064eb4-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:12.181054 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.181020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:12.306298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.306273    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"
Sep 11 13:47:12.306526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.306310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn" event={"ID":"61bb3161-33bf-4395-a36a-c22657064eb4","Type":"ContainerDied","Data":"f05812a7c0ca9d32968d54231149f1b5b0d71cc2c6e824b3be441bd2402b0580"}
Sep 11 13:47:12.306526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.306381    2582 scope.go:117] "RemoveContainer" containerID="f4d8aa8ce70834e25229058afd9f60c6b52dba190191e2f7c80dc1a32bc074d9"
Sep 11 13:47:12.346491 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.346462    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:47:12.352457 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.352433    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-65a9ed-openshift-default-6c9bf465d4-8qhsn"]
Sep 11 13:47:12.857339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:12.857304    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" path="/var/lib/kubelet/pods/61bb3161-33bf-4395-a36a-c22657064eb4/volumes"
Sep 11 13:47:13.138776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:13.138697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:15.647769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:15.647736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:15.730371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:15.730333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:22.399207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:22.399172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:22.545377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:22.545337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:22.681209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:22.681118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:22.890655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:22.890623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:22.977478 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:22.977395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:23.336487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:23.336456    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:23.442293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:23.442261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:24.405464 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:24.405429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:25.410721 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:25.410681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:26.570466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:26.570434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:27.685421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:27.685379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:30.792456 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:30.792420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:30.900658 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:30.900623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:31.123806 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.123725    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:47:31.123957 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.123925    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" containerID="cri-o://1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52" gracePeriod=30
Sep 11 13:47:31.160764 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.160733    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:31.446983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.446882    2582 patch_prober.go:28] interesting pod/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:47:31.446983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.446945    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:47:31.896729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:31.896692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:33.536027 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:33.535995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:35.100887 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:35.100854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:36.370977 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.370953    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:47:36.445728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.445637    2582 generic.go:356] "Generic (PLEG): container finished" podID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerID="1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52" exitCode=0
Sep 11 13:47:36.445728 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.445688    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"
Sep 11 13:47:36.445958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.445725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerDied","Data":"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"}
Sep 11 13:47:36.445958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.445792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl" event={"ID":"29f264e9-a90f-4eeb-9991-3acfde1bd415","Type":"ContainerDied","Data":"a0a694548ef4513f123065bd91e9512a8d7790ea9bc3eaa6698e7decfd5b7fe2"}
Sep 11 13:47:36.445958 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.445825    2582 scope.go:117] "RemoveContainer" containerID="1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"
Sep 11 13:47:36.457097 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.457078    2582 scope.go:117] "RemoveContainer" containerID="c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"
Sep 11 13:47:36.465466 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.465451    2582 scope.go:117] "RemoveContainer" containerID="1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"
Sep 11 13:47:36.465753 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:47:36.465733    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52\": container with ID starting with 1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52 not found: ID does not exist" containerID="1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"
Sep 11 13:47:36.465847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.465767    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52"} err="failed to get container status \"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52\": rpc error: code = NotFound desc = could not find container \"1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52\": container with ID starting with 1c5201373d6b165fe601270adca3ccbdcd4a891d30359f2b7d446b20291aee52 not found: ID does not exist"
Sep 11 13:47:36.465847 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.465791    2582 scope.go:117] "RemoveContainer" containerID="c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"
Sep 11 13:47:36.466071 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:47:36.466053    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba\": container with ID starting with c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba not found: ID does not exist" containerID="c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"
Sep 11 13:47:36.466118 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.466078    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba"} err="failed to get container status \"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba\": rpc error: code = NotFound desc = could not find container \"c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba\": container with ID starting with c76326de80fbc0ef907c12dbbcd7e0e6fb20c83ca4ec536881232dfce73395ba not found: ID does not exist"
Sep 11 13:47:36.526616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526588    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526624    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526669    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526787    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkvkf\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.526959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526836    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:36.526959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526899    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data" (OuterVolumeSpecName: "istio-data") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:36.526959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526925    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.527251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:36.527251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.526988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy\") pod \"29f264e9-a90f-4eeb-9991-3acfde1bd415\" (UID: \"29f264e9-a90f-4eeb-9991-3acfde1bd415\") "
Sep 11 13:47:36.527251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527072    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:36.527251 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527195    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:47:36.527470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527409    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.527470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527425    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.527470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527443    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.527470 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527461    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.527663 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.527474    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29f264e9-a90f-4eeb-9991-3acfde1bd415-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.529121 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.529093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:36.529121 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.529108    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:47:36.529398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.529377    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token" (OuterVolumeSpecName: "istio-token") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:36.529398 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.529386    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf" (OuterVolumeSpecName: "kube-api-access-tkvkf") pod "29f264e9-a90f-4eeb-9991-3acfde1bd415" (UID: "29f264e9-a90f-4eeb-9991-3acfde1bd415"). InnerVolumeSpecName "kube-api-access-tkvkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:36.628601 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.628571    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.628601 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.628598    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkvkf\" (UniqueName: \"kubernetes.io/projected/29f264e9-a90f-4eeb-9991-3acfde1bd415-kube-api-access-tkvkf\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.628812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.628610    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.628812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.628619    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29f264e9-a90f-4eeb-9991-3acfde1bd415-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:36.705788 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.705666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:36.782075 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.782042    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:47:36.791556 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.791526    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ab77a5-openshift-default-64f6c6fdd4-f92hl"]
Sep 11 13:47:36.853611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:36.853582    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" path="/var/lib/kubelet/pods/29f264e9-a90f-4eeb-9991-3acfde1bd415/volumes"
Sep 11 13:47:38.100870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:38.100837    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:39.555778 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:39.555741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:41.884741 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:41.884705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:42.013548 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:42.013496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:42.363358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:42.363327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:42.533687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:42.533654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:42.821642 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:42.821608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:42.944125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:42.944091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:43.357700 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:43.357662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:43.519413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:43.519381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:44.597495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:44.597457    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:45.814314 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:45.814281    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:46.832408 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:46.832376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:47.708008 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:47.707971    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:47:47.753319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:47.753271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:48.622321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:48.622286    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:47:48.672131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:48.672096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:49.088244 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.088212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:49.412561 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.412441    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:47:49.413037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413015    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.413138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413040    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.413138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413051    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413089    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413100    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.413138 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413109    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413160    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413169    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413282    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413296    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413308    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="61bb3161-33bf-4395-a36a-c22657064eb4" containerName="istio-proxy"
Sep 11 13:47:49.413415 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.413323    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f264e9-a90f-4eeb-9991-3acfde1bd415" containerName="istio-proxy"
Sep 11 13:47:49.416448 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.416429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.421159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.421138    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-4920fa-openshift-default-dockercfg-nbdbq\""
Sep 11 13:47:49.434438 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.434409    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:47:49.470202 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.470171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:49.472546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472620 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472783 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q8sf\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.472991 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.472949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.573705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q8sf\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.573905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.573905 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.573986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574226 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574226 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574336 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574519 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.574753 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.574736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.576191 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.576169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.576528 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.576494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.586708 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.586683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q8sf\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.586964 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.586949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token\") pod \"e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") " pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:49.691432 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.691330    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:49.727156 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:49.727122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:50.011523 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.011479    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:47:50.014091 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:47:50.014053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20880b96_ab61_48e9_a543_f21c6c8fcf66.slice/crio-b5cc7395485eafd3c27b4e94c68254adae0b34cf187cc9da0fad978d24d78b47 WatchSource:0}: Error finding container b5cc7395485eafd3c27b4e94c68254adae0b34cf187cc9da0fad978d24d78b47: Status 404 returned error can't find the container with id b5cc7395485eafd3c27b4e94c68254adae0b34cf187cc9da0fad978d24d78b47
Sep 11 13:47:50.016695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.016652    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:47:50.016768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.016749    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:47:50.016809 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.016795    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:47:50.529085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.529052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerStarted","Data":"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"}
Sep 11 13:47:50.529242 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.529105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerStarted","Data":"b5cc7395485eafd3c27b4e94c68254adae0b34cf187cc9da0fad978d24d78b47"}
Sep 11 13:47:50.560345 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.560290    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podStartSLOduration=1.560274929 podStartE2EDuration="1.560274929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:47:50.554628383 +0000 UTC m=+1684.387063522" watchObservedRunningTime="2026-09-11 13:47:50.560274929 +0000 UTC m=+1684.392710068"
Sep 11 13:47:50.728284 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.728252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:50.834738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.834659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:50.960752 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:50.960721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:51.088686 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:51.088611    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:47:51.088830 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:51.088801    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy" containerID="cri-o://2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719" gracePeriod=30
Sep 11 13:47:51.109233 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:51.109191    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:51.734597 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:51.734562    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:51.772607 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:51.772577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:52.542444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:52.542415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:52.543489 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:52.543463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:47:52.729181 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:52.729145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:52.873159 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:52.873046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:54.447260 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:54.447215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:55.894096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:55.894052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:56.339673 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.339648    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:47:56.450404 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450442    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kd6v\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450558    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.450896 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450763    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket\") pod \"a22b1f2f-708f-4cfc-804a-09e5b989da18\" (UID: \"a22b1f2f-708f-4cfc-804a-09e5b989da18\") "
Sep 11 13:47:56.451054 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450935    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data" (OuterVolumeSpecName: "istio-data") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:56.451054 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.450954    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:47:56.451158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451139    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:56.451158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:56.451259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451212    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:56.451389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451372    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.451459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451396    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.451459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451410    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.451459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451423    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a22b1f2f-708f-4cfc-804a-09e5b989da18-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.451459 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.451438    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.452836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.452805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:47:56.453083 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.453056    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token" (OuterVolumeSpecName: "istio-token") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:56.453207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.453184    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v" (OuterVolumeSpecName: "kube-api-access-2kd6v") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "kube-api-access-2kd6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:56.453258 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.453193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a22b1f2f-708f-4cfc-804a-09e5b989da18" (UID: "a22b1f2f-708f-4cfc-804a-09e5b989da18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:47:56.552278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.552246    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.552278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.552273    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kd6v\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-kube-api-access-2kd6v\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.552278 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.552283    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.552488 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.552292    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a22b1f2f-708f-4cfc-804a-09e5b989da18-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:47:56.566450 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.566423    2582 generic.go:356] "Generic (PLEG): container finished" podID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerID="2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719" exitCode=0
Sep 11 13:47:56.566599 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.566486    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"
Sep 11 13:47:56.566599 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.566534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerDied","Data":"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"}
Sep 11 13:47:56.566599 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.566593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj" event={"ID":"a22b1f2f-708f-4cfc-804a-09e5b989da18","Type":"ContainerDied","Data":"308a2f14fada46553cea9813cee5335f2caec6e8f511dab9e9efbbfc78586007"}
Sep 11 13:47:56.566712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.566627    2582 scope.go:117] "RemoveContainer" containerID="2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"
Sep 11 13:47:56.576314 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.576298    2582 scope.go:117] "RemoveContainer" containerID="154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"
Sep 11 13:47:56.584408 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.584388    2582 scope.go:117] "RemoveContainer" containerID="2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"
Sep 11 13:47:56.584768 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:47:56.584748    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719\": container with ID starting with 2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719 not found: ID does not exist" containerID="2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"
Sep 11 13:47:56.584821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.584778    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719"} err="failed to get container status \"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719\": rpc error: code = NotFound desc = could not find container \"2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719\": container with ID starting with 2feb6ccb22c341d802629952f71c2a3ab5a8fedf9584230c0271e1f1be289719 not found: ID does not exist"
Sep 11 13:47:56.584821 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.584795    2582 scope.go:117] "RemoveContainer" containerID="154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"
Sep 11 13:47:56.585047 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:47:56.585029    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05\": container with ID starting with 154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05 not found: ID does not exist" containerID="154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"
Sep 11 13:47:56.585143 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.585052    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05"} err="failed to get container status \"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05\": rpc error: code = NotFound desc = could not find container \"154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05\": container with ID starting with 154d76921fd118b2ca62046f0b41dd56ea8eb92cab9b9cbc71a27c0d19536b05 not found: ID does not exist"
Sep 11 13:47:56.600582 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.600557    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:47:56.609655 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.609634    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7bfa93-openshift-default-69f697d6f8-khdrj"]
Sep 11 13:47:56.852872 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:56.852840    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" path="/var/lib/kubelet/pods/a22b1f2f-708f-4cfc-804a-09e5b989da18/volumes"
Sep 11 13:47:57.090938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:57.090901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:58.217917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:58.217878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:58.322607 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:58.322561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:58.637254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:58.637209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:58.865298 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:58.865264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:47:58.976682 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:47:58.976598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:01.608372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:01.608334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:01.740733 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:01.740703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:01.870261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:01.870174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:01.991842 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:01.991806    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:02.411572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:02.411540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:02.629893 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:02.629838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:02.734541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:02.734440    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" podUID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" containerName="main" containerID="cri-o://a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f" gracePeriod=45
Sep 11 13:48:02.996451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:02.996387    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:48:03.123117 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123281    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123306    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv86q\" (UniqueName: \"kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123442 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home\") pod \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\" (UID: \"1eba609e-e1d3-4cc4-a31c-95d9438ebc62\") "
Sep 11 13:48:03.123595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123569    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache" (OuterVolumeSpecName: "model-cache") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:03.124190 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.123949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home" (OuterVolumeSpecName: "home") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:03.124190 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.124142    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:03.126124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.124964    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.126124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.124997    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.126124 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.125015    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.131545 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.129608    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm" (OuterVolumeSpecName: "dshm") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:03.133129 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.133102    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:48:03.133129 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.133115    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q" (OuterVolumeSpecName: "kube-api-access-sv86q") pod "1eba609e-e1d3-4cc4-a31c-95d9438ebc62" (UID: "1eba609e-e1d3-4cc4-a31c-95d9438ebc62"). InnerVolumeSpecName "kube-api-access-sv86q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:48:03.226065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.226027    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv86q\" (UniqueName: \"kubernetes.io/projected/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-kube-api-access-sv86q\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.226065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.226061    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.226065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.226072    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1eba609e-e1d3-4cc4-a31c-95d9438ebc62-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:03.611536 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.611481    2582 generic.go:356] "Generic (PLEG): container finished" podID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" containerID="a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f" exitCode=0
Sep 11 13:48:03.611746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.611563    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"
Sep 11 13:48:03.611746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.611571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" event={"ID":"1eba609e-e1d3-4cc4-a31c-95d9438ebc62","Type":"ContainerDied","Data":"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"}
Sep 11 13:48:03.611746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.611629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp" event={"ID":"1eba609e-e1d3-4cc4-a31c-95d9438ebc62","Type":"ContainerDied","Data":"ae06e4bc0d24df97f644c20ddb9221393b0aad25eb366e5d50a85d2f76d230e0"}
Sep 11 13:48:03.611746 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.611653    2582 scope.go:117] "RemoveContainer" containerID="a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"
Sep 11 13:48:03.621546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.621528    2582 scope.go:117] "RemoveContainer" containerID="a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"
Sep 11 13:48:03.621779 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:03.621762    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f\": container with ID starting with a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f not found: ID does not exist" containerID="a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"
Sep 11 13:48:03.621836 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.621787    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f"} err="failed to get container status \"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f\": rpc error: code = NotFound desc = could not find container \"a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f\": container with ID starting with a553e9be4fbfcececf313c4e4fa1a97e5f1cafb227d3d9ff7e5de8fdc6a5f51f not found: ID does not exist"
Sep 11 13:48:03.641101 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.641067    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" containerName="main" containerID="cri-o://7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce" gracePeriod=45
Sep 11 13:48:03.645454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.645431    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:48:03.654730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.654706    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3dd80c/rate-test-model-3dd80c-kserve-7cfbccf675-55sqp"]
Sep 11 13:48:03.704605 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.704564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:03.906112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:03.906087    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:48:04.034584 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034667    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034739    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034861    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:04.034989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir\") pod \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\" (UID: \"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184\") "
Sep 11 13:48:04.034989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.034966    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home" (OuterVolumeSpecName: "home") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:04.035148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.035056    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:04.035374 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.035358    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.035432 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.035375    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.035432 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.035384    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.036760 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.036738    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:48:04.037207 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.037189    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm" (OuterVolumeSpecName: "dshm") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:04.037252 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.037218    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh" (OuterVolumeSpecName: "kube-api-access-jp6zh") pod "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" (UID: "a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184"). InnerVolumeSpecName "kube-api-access-jp6zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:48:04.136177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.136091    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.136177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.136120    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.136177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.136129    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp6zh\" (UniqueName: \"kubernetes.io/projected/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184-kube-api-access-jp6zh\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:04.619422 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.619383    2582 generic.go:356] "Generic (PLEG): container finished" podID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" containerID="7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce" exitCode=0
Sep 11 13:48:04.619646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.619432    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"
Sep 11 13:48:04.619646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.619465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" event={"ID":"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184","Type":"ContainerDied","Data":"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"}
Sep 11 13:48:04.619646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.619523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs" event={"ID":"a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184","Type":"ContainerDied","Data":"28ec28317a1ff40dd7ca5433f4cb93b936fbf049c1e8ed18b7bed3396f5a6b31"}
Sep 11 13:48:04.619646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.619547    2582 scope.go:117] "RemoveContainer" containerID="7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"
Sep 11 13:48:04.629037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.629018    2582 scope.go:117] "RemoveContainer" containerID="7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"
Sep 11 13:48:04.629284 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:04.629269    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce\": container with ID starting with 7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce not found: ID does not exist" containerID="7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"
Sep 11 13:48:04.629321 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.629292    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce"} err="failed to get container status \"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce\": rpc error: code = NotFound desc = could not find container \"7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce\": container with ID starting with 7e9e58fd20bbd82a3924590a72514e05865691ef56eaf4302eca3cb9a940d7ce not found: ID does not exist"
Sep 11 13:48:04.659328 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.659290    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:48:04.669614 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.669583    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6ca2b/rate-test-model-d6ca2b-kserve-558cb8dbdc-4fxvs"]
Sep 11 13:48:04.852717 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.852680    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" path="/var/lib/kubelet/pods/1eba609e-e1d3-4cc4-a31c-95d9438ebc62/volumes"
Sep 11 13:48:04.853293 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:04.853276    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" path="/var/lib/kubelet/pods/a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184/volumes"
Sep 11 13:48:05.425824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:05.425792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:06.992974 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:06.992939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:10.762331 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:10.762248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:11.021572 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:11.021479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:11.100986 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:11.100945    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:48:11.101214 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:11.101166    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy" containerID="cri-o://8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678" gracePeriod=30
Sep 11 13:48:11.223024 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:11.222985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:13.672777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.672674    2582 generic.go:356] "Generic (PLEG): container finished" podID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerID="8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754" exitCode=0
Sep 11 13:48:13.672777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.672747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerDied","Data":"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"}
Sep 11 13:48:13.673282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.673154    2582 scope.go:117] "RemoveContainer" containerID="8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"
Sep 11 13:48:13.674228 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.674200    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:13.674289 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.674269    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:13.674326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:13.674301    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:14.689248 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:14.689199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerStarted","Data":"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"}
Sep 11 13:48:14.727707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:14.727656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:48:14.727917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:14.727892    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:14.727997 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:14.727952    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:15.728158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:15.728115    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:15.728690 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:15.728178    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:16.395481 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.395400    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589610    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589652    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589756    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npmhr\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.590692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.589901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo\") pod \"52b8c389-1bad-4588-a8f0-d8cce744e970\" (UID: \"52b8c389-1bad-4588-a8f0-d8cce744e970\") "
Sep 11 13:48:16.591337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.590861    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:16.591337 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.591025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data" (OuterVolumeSpecName: "istio-data") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:16.592371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.591707    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:16.592371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.591956    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:48:16.592371 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.592098    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:16.593719 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.593683    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token" (OuterVolumeSpecName: "istio-token") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:48:16.595546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.594838    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr" (OuterVolumeSpecName: "kube-api-access-npmhr") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "kube-api-access-npmhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:48:16.595546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.595008    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:48:16.595812 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.595783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52b8c389-1bad-4588-a8f0-d8cce744e970" (UID: "52b8c389-1bad-4588-a8f0-d8cce744e970"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691818    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691864    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691879    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691894    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b8c389-1bad-4588-a8f0-d8cce744e970-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691908    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691922    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691934    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npmhr\" (UniqueName: \"kubernetes.io/projected/52b8c389-1bad-4588-a8f0-d8cce744e970-kube-api-access-npmhr\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691947    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.692061 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.691962    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b8c389-1bad-4588-a8f0-d8cce744e970-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:48:16.703858 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.703827    2582 generic.go:356] "Generic (PLEG): container finished" podID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerID="8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678" exitCode=0
Sep 11 13:48:16.704029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.703870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"
Sep 11 13:48:16.704029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.703887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerDied","Data":"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"}
Sep 11 13:48:16.704029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.703928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q" event={"ID":"52b8c389-1bad-4588-a8f0-d8cce744e970","Type":"ContainerDied","Data":"50a6d70e2ce4f7fc2556ab5edca0cb6cd3fe2c2746ad6aa520825c5860238826"}
Sep 11 13:48:16.704029 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.703950    2582 scope.go:117] "RemoveContainer" containerID="8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"
Sep 11 13:48:16.715204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.715185    2582 scope.go:117] "RemoveContainer" containerID="faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"
Sep 11 13:48:16.723629 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.723609    2582 scope.go:117] "RemoveContainer" containerID="8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"
Sep 11 13:48:16.723921 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:16.723896    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678\": container with ID starting with 8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678 not found: ID does not exist" containerID="8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"
Sep 11 13:48:16.724023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.723925    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678"} err="failed to get container status \"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678\": rpc error: code = NotFound desc = could not find container \"8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678\": container with ID starting with 8abcc023c862f040e8e400b3b6265e5b613b4f0b192a8c4d7b5985192129a678 not found: ID does not exist"
Sep 11 13:48:16.724023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.723944    2582 scope.go:117] "RemoveContainer" containerID="faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"
Sep 11 13:48:16.724210 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:16.724195    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85\": container with ID starting with faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85 not found: ID does not exist" containerID="faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"
Sep 11 13:48:16.724259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.724215    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85"} err="failed to get container status \"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85\": rpc error: code = NotFound desc = could not find container \"faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85\": container with ID starting with faf5668101cb553d5d9f3f1ef8bfeb7c6c86162a5d6cb1ff3b15e8f3489fae85 not found: ID does not exist"
Sep 11 13:48:16.727542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.727523    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:16.727603 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.727577    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:16.742339 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.742314    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:48:16.750006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.749985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-32b673-openshift-default-69c9cc678b-85m7q"]
Sep 11 13:48:16.853131 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:16.853095    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" path="/var/lib/kubelet/pods/52b8c389-1bad-4588-a8f0-d8cce744e970/volumes"
Sep 11 13:48:17.728155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:17.728115    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:17.728476 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:17.728191    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:18.728248 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:18.728214    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:18.728634 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:18.728271    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:19.727587 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:19.727550    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:48:19.727768 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:19.727616    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 13:48:20.731539 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:20.731490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:48:20.731965 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:20.731940    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:48:20.732745 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:20.732721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:48:20.966718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:20.966682    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:23.447515 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:23.447449    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:24.075232 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:24.075198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:24.499493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:24.499407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:24.987665 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:24.987632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:25.298025 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.297994    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:48:25.298419 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298407    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298421    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298435    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298440    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298446    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" containerName="main"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298451    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" containerName="main"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298457    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" containerName="main"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298463    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" containerName="main"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298470    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298473 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298475    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298489    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298494    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298569    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298577    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a22b1f2f-708f-4cfc-804a-09e5b989da18" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298585    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9a1b5ee-a8d8-4ae4-a05a-1b6a0b12d184" containerName="main"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298592    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298598    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eba609e-e1d3-4cc4-a31c-95d9438ebc62" containerName="main"
Sep 11 13:48:25.298793 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.298604    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b8c389-1bad-4588-a8f0-d8cce744e970" containerName="istio-proxy"
Sep 11 13:48:25.300757 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.300743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.323651 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.323630    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9efb13-openshift-default-dockercfg-wz8j8\""
Sep 11 13:48:25.382660 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382838 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382838 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrpg\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382838 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.382971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382932    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.383122 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.382976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.483576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrpg\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.483771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.483771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.483771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.483771 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484000 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.483921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.484130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.484160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.484254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.484296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.484667 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.484646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.486012 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.485994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.486397 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.486376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.549053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.548975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrpg\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.593963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.593934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token\") pod \"e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") " pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.610965 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.610934    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:25.744779 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.744741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:25.754755 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:25.754718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:48:26.111254 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.111186    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:48:26.153147 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:48:26.153118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9c5278_8e8a_4656_8e1a_bc45626b28bc.slice/crio-41f70b82ed8473b00d81d44c82c1c15ca8abd21bfbf77e8a683753bb97f1d5af WatchSource:0}: Error finding container 41f70b82ed8473b00d81d44c82c1c15ca8abd21bfbf77e8a683753bb97f1d5af: Status 404 returned error can't find the container with id 41f70b82ed8473b00d81d44c82c1c15ca8abd21bfbf77e8a683753bb97f1d5af
Sep 11 13:48:26.155325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.155291    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:26.155421 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.155372    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:26.155485 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.155416    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:26.763581 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.763544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerStarted","Data":"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"}
Sep 11 13:48:26.763983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.763607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerStarted","Data":"41f70b82ed8473b00d81d44c82c1c15ca8abd21bfbf77e8a683753bb97f1d5af"}
Sep 11 13:48:26.813595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:26.813536    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podStartSLOduration=1.8135208600000001 podStartE2EDuration="1.81352086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:48:26.809773441 +0000 UTC m=+1720.642208592" watchObservedRunningTime="2026-09-11 13:48:26.81352086 +0000 UTC m=+1720.645956000"
Sep 11 13:48:27.317368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:27.317334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:27.611600 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:27.611491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:27.616702 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:27.616680    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:27.769281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:27.769249    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:27.770180 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:27.770156    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:29.030612 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:29.030577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:29.421577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:29.421457    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:29.881613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:29.881578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:31.374441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:31.374407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:33.644713 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.644683    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:48:33.647738 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.647721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.660831 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.660808    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-9efb13-serving-cert\""
Sep 11 13:48:33.703031 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.702998    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:48:33.750628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.750598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:33.772650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.772624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.772782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.772657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.772782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.772745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.772860 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.772821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdt6\" (UniqueName: \"kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.873729 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.873693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.873924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.873735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.873924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.873811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.873924 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.873870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdt6\" (UniqueName: \"kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.873924 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:33.873876    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-serving-cert: secret "maas-api-e2e-ipp-b-9efb13-serving-cert" not found
Sep 11 13:48:33.874143 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:48:33.873943    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls podName:5df49f00-f36e-4e22-9ae8-212a146cc64f nodeName:}" failed. No retries permitted until 2026-09-11 13:48:34.373921863 +0000 UTC m=+1728.206356984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls") pod "maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" (UID: "5df49f00-f36e-4e22-9ae8-212a146cc64f") : secret "maas-api-e2e-ipp-b-9efb13-serving-cert" not found
Sep 11 13:48:33.874532 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.874479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.876183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.876165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.893608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.893581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdt6\" (UniqueName: \"kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:33.980928 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:33.980849    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:34.379762 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:34.379724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:34.382171 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:34.382146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:34.385418 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:34.385398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:34.558714 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:34.558681    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:34.859005 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:48:34.858971    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df49f00_f36e_4e22_9ae8_212a146cc64f.slice/crio-4f8db62d5e670e05b5702e0d0de59460c1eb19eb140d90fd99217cbd8559d988 WatchSource:0}: Error finding container 4f8db62d5e670e05b5702e0d0de59460c1eb19eb140d90fd99217cbd8559d988: Status 404 returned error can't find the container with id 4f8db62d5e670e05b5702e0d0de59460c1eb19eb140d90fd99217cbd8559d988
Sep 11 13:48:34.870333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:34.870301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:48:35.076705 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:35.076667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:35.565608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:35.565575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:35.815360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:35.815322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" event={"ID":"5df49f00-f36e-4e22-9ae8-212a146cc64f","Type":"ContainerStarted","Data":"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"}
Sep 11 13:48:35.815576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:35.815386    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:35.815576 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:35.815409    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" event={"ID":"5df49f00-f36e-4e22-9ae8-212a146cc64f","Type":"ContainerStarted","Data":"4f8db62d5e670e05b5702e0d0de59460c1eb19eb140d90fd99217cbd8559d988"}
Sep 11 13:48:36.217283 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:36.217230    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" podStartSLOduration=2.931173383 podStartE2EDuration="3.217211428s" totalImagesPullingTime="286.038045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:48:36.197687756 +0000 UTC m=+1730.030122896" watchObservedRunningTime="2026-09-11 13:48:36.217211428 +0000 UTC m=+1730.049646567"
Sep 11 13:48:37.114842 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:37.114786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:38.593248 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:38.593202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:39.946654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:39.946617    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:41.825906 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:41.825875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:48:49.893650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.893568    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerID="16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6" exitCode=0
Sep 11 13:48:49.894033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.893641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerDied","Data":"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"}
Sep 11 13:48:49.894033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.893983    2582 scope.go:117] "RemoveContainer" containerID="16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"
Sep 11 13:48:49.895089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.895063    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:49.895154 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.895137    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:49.895189 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:49.895169    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:48:50.903034 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:50.902994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerStarted","Data":"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"}
Sep 11 13:48:51.611960 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:51.611921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:51.612204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:51.612179    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 13:48:51.612261 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:51.612243    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 13:48:51.748940 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:51.748906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:52.611932 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:52.611894    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 13:48:52.612326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:52.611953    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 13:48:53.611825 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:53.611787    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 13:48:53.612032 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:53.611862    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 13:48:54.612296 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:54.612253    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 13:48:54.612791 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:54.612315    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 13:48:55.611654 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:55.611617    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 13:48:55.611834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:55.611708    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 13:48:56.616452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:56.616416    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:56.616917 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:56.616896    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:56.617666 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:56.617648    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:48:58.295851 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:58.295799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:59.244785 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:59.244753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:48:59.404928 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:48:59.404880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:00.422920 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:00.422885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:01.270983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:01.270948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:02.093628 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:02.093596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:08.466892 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:08.466860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:31.955087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:31.955053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:32.417971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.417931    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:49:32.420689 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.420665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.426145 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.426121    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-2e3865-openshift-default-dockercfg-rxz2x\""
Sep 11 13:49:32.459333 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.459301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:49:32.490495 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.490462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.490874 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.490839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491094 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491465 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jd6k\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491553 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491621 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491677 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.491828 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.491787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.563270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.563230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:32.592747 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.592921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.592921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.592921 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jd6k\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.592983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593099 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593102    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593527 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593657 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593657 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593548    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.593657 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.593602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.595196 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.595177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.595426 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.595409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.605629 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.605610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.606998 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.606979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jd6k\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k\") pod \"e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") " pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:32.670454 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.670392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:32.730683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:32.730661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:33.013797 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.013773    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:49:33.015545 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:49:33.015524    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d90fa1_346c_43b0_99c8_dc1a9e345d08.slice/crio-cd079d4e726e787aab053bd1dd1a7b40cc11d73f6d305fbbf72457883d1400a0 WatchSource:0}: Error finding container cd079d4e726e787aab053bd1dd1a7b40cc11d73f6d305fbbf72457883d1400a0: Status 404 returned error can't find the container with id cd079d4e726e787aab053bd1dd1a7b40cc11d73f6d305fbbf72457883d1400a0
Sep 11 13:49:33.017716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.017680    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:33.017808 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.017746    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:33.017808 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.017775    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:33.124542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.124484    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerStarted","Data":"4a26d0b299a1846bb5b7b02624b5bf918aaafd78d6c4d03771e8f086858382c1"}
Sep 11 13:49:33.124692 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.124563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerStarted","Data":"cd079d4e726e787aab053bd1dd1a7b40cc11d73f6d305fbbf72457883d1400a0"}
Sep 11 13:49:33.150699 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.150654    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podStartSLOduration=1.150637455 podStartE2EDuration="1.150637455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:49:33.148601409 +0000 UTC m=+1786.981036550" watchObservedRunningTime="2026-09-11 13:49:33.150637455 +0000 UTC m=+1786.983072595"
Sep 11 13:49:33.731684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:33.731656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:34.728092 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:34.728059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:34.736080 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:34.736050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:35.134444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:35.134417    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:35.135368 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:35.135348    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:35.386122 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:35.386038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:35.514360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:35.514326    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:35.819787 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:35.819754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:37.462098 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:37.462068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:38.503395 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:38.503360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:39.536845 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:39.536760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:40.498712 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:40.498675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:40.577318 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:40.577288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:40.819265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:40.819232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:41.135557 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:41.135469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:41.239546 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:41.239512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:49:55.248568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.248537    2582 generic.go:356] "Generic (PLEG): container finished" podID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerID="4a26d0b299a1846bb5b7b02624b5bf918aaafd78d6c4d03771e8f086858382c1" exitCode=0
Sep 11 13:49:55.248923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.248606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerDied","Data":"4a26d0b299a1846bb5b7b02624b5bf918aaafd78d6c4d03771e8f086858382c1"}
Sep 11 13:49:55.249037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.249018    2582 scope.go:117] "RemoveContainer" containerID="4a26d0b299a1846bb5b7b02624b5bf918aaafd78d6c4d03771e8f086858382c1"
Sep 11 13:49:55.250160 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.250130    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:55.250227 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.250215    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:55.250265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:55.250249    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:49:56.256218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:56.256181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerStarted","Data":"d674692524f607ece84233b1f5224da051d5aa256772d642bd45a46ba2096032"}
Sep 11 13:49:56.731578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:56.731543    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:49:56.731782 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:56.731757    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:49:56.731861 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:56.731818    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 13:49:57.731938 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:57.731899    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:49:57.732326 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:57.731966    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 13:49:58.731168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:58.731136    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:49:58.731372 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:58.731194    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 13:49:59.731270 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:59.731235    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:49:59.731679 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:49:59.731296    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 13:50:00.731879 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:00.731839    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:50:00.732265 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:00.731898    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 11 13:50:01.734978 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:01.734947    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:50:01.735373 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:01.735227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:50:01.735813 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:01.735796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:50:03.009033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:03.008993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:03.963926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:03.963890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:04.875355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:04.875316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:05.967955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:05.967923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:06.659777 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:06.659748    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:06.785120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:06.785082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:07.791814 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:07.791778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:09.104062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:09.104020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:10.117622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:10.117575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:11.366310 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:11.366271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:12.262016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:12.261983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:13.111571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:13.111536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:14.137065 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:14.137033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:18.703285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:18.703241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:18.852716 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:18.852680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:18.974826 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:18.974699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:19.137141 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:19.137095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:19.628220 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:19.628188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:19.875441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:19.875381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:20.717631 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:20.717581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:21.686683 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:21.686633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:22.660956 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:22.660923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:23.726050 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:23.726017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:25.958440 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:25.958401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:26.063431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:26.063392    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:26.286890 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:26.286858    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:50:26.287183 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:26.287128    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy" containerID="cri-o://d674692524f607ece84233b1f5224da051d5aa256772d642bd45a46ba2096032" gracePeriod=30
Sep 11 13:50:26.316133 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:26.316103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:31.457474 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.457012    2582 generic.go:356] "Generic (PLEG): container finished" podID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerID="d674692524f607ece84233b1f5224da051d5aa256772d642bd45a46ba2096032" exitCode=0
Sep 11 13:50:31.457474 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.457242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerDied","Data":"d674692524f607ece84233b1f5224da051d5aa256772d642bd45a46ba2096032"}
Sep 11 13:50:31.457474 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.457339    2582 scope.go:117] "RemoveContainer" containerID="4a26d0b299a1846bb5b7b02624b5bf918aaafd78d6c4d03771e8f086858382c1"
Sep 11 13:50:31.543824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.543794    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:50:31.709604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709527    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709560    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709599    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.709870 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:50:31.710087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709875    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.710087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709910    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.710087 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.709961    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jd6k\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k\") pod \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\" (UID: \"24d90fa1-346c-43b0-99c8-dc1a9e345d08\") "
Sep 11 13:50:31.710249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:50:31.710249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710170    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data" (OuterVolumeSpecName: "istio-data") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:50:31.710249 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710179    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:50:31.710385 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:50:31.710452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710434    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.710541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710456    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.710541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710470    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.710541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710483    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.710541 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.710496    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.712011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.711981    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:50:31.712125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.712011    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:50:31.712125 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.712069    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token" (OuterVolumeSpecName: "istio-token") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:50:31.712364 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.712338    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k" (OuterVolumeSpecName: "kube-api-access-8jd6k") pod "24d90fa1-346c-43b0-99c8-dc1a9e345d08" (UID: "24d90fa1-346c-43b0-99c8-dc1a9e345d08"). InnerVolumeSpecName "kube-api-access-8jd6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:50:31.811854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.811830    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.811854 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.811853    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.812020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.811862    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d90fa1-346c-43b0-99c8-dc1a9e345d08-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:31.812020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:31.811870    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jd6k\" (UniqueName: \"kubernetes.io/projected/24d90fa1-346c-43b0-99c8-dc1a9e345d08-kube-api-access-8jd6k\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:50:32.278577 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.278545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:32.463569 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.463542    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"
Sep 11 13:50:32.464028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.463565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm" event={"ID":"24d90fa1-346c-43b0-99c8-dc1a9e345d08","Type":"ContainerDied","Data":"cd079d4e726e787aab053bd1dd1a7b40cc11d73f6d305fbbf72457883d1400a0"}
Sep 11 13:50:32.464028 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.463624    2582 scope.go:117] "RemoveContainer" containerID="d674692524f607ece84233b1f5224da051d5aa256772d642bd45a46ba2096032"
Sep 11 13:50:32.510210 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.510177    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:50:32.517153 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.517130    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-2e3865-openshift-default-59c8bbb7bb-qc2nm"]
Sep 11 13:50:32.853163 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:32.853133    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" path="/var/lib/kubelet/pods/24d90fa1-346c-43b0-99c8-dc1a9e345d08/volumes"
Sep 11 13:50:33.705560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:33.705522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:34.896399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:34.896370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:35.925334 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:35.925286    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:37.017865 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:37.017835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:39.195770 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:39.195738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:41.482358 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:41.482324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.265526 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.265423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.349534 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.349486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.449824 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.449784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.554590 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.554553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.622739 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.622704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:47.974460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:47.974380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:48.077703 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:48.077666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:48.772170 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:48.772139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:49.789727 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:49.789680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:50.548956 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:50.548921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:50:53.028086 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:50:53.028053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:13.842977 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:13.842893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:15.794609 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:15.794575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:23.107598 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:23.107555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:23.174675 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:23.174644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:29.495222 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:29.495175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:30.477684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:30.477644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:36.187206 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:36.187166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:36.293309 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:36.293278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:36.509049 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:36.508972    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:51:36.509199 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:36.509176    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy" containerID="cri-o://bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be" gracePeriod=30
Sep 11 13:51:36.523114 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:36.523087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:37.108361 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:37.108328    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:37.937085 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:37.937048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:38.761343 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:38.761308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:39.490633 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:39.490598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:40.298336 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:40.298302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:41.771311 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.771247    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:51:41.830255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.830222    2582 generic.go:356] "Generic (PLEG): container finished" podID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerID="bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be" exitCode=0
Sep 11 13:51:41.830446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.830278    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"
Sep 11 13:51:41.830446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.830291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerDied","Data":"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"}
Sep 11 13:51:41.830446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.830368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb" event={"ID":"20880b96-ab61-48e9-a543-f21c6c8fcf66","Type":"ContainerDied","Data":"b5cc7395485eafd3c27b4e94c68254adae0b34cf187cc9da0fad978d24d78b47"}
Sep 11 13:51:41.830446 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.830398    2582 scope.go:117] "RemoveContainer" containerID="bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"
Sep 11 13:51:41.839613 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.839591    2582 scope.go:117] "RemoveContainer" containerID="8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"
Sep 11 13:51:41.848247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.848227    2582 scope.go:117] "RemoveContainer" containerID="bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"
Sep 11 13:51:41.848550 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:51:41.848529    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be\": container with ID starting with bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be not found: ID does not exist" containerID="bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"
Sep 11 13:51:41.848611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.848561    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be"} err="failed to get container status \"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be\": rpc error: code = NotFound desc = could not find container \"bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be\": container with ID starting with bceb7c3a61f254682cd8f235251060d47141169d828cc833afaaa402417852be not found: ID does not exist"
Sep 11 13:51:41.848611 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.848580    2582 scope.go:117] "RemoveContainer" containerID="8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"
Sep 11 13:51:41.848838 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:51:41.848820    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754\": container with ID starting with 8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754 not found: ID does not exist" containerID="8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"
Sep 11 13:51:41.848891 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.848847    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754"} err="failed to get container status \"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754\": rpc error: code = NotFound desc = could not find container \"8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754\": container with ID starting with 8e130a3f7abde15c3666f410f00e870bcbc74edf29ffd47610a33dddf92f1754 not found: ID does not exist"
Sep 11 13:51:41.889157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q8sf\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889325 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889305    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889443    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:41.889571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889541    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data" (OuterVolumeSpecName: "istio-data") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:41.889834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy\") pod \"20880b96-ab61-48e9-a543-f21c6c8fcf66\" (UID: \"20880b96-ab61-48e9-a543-f21c6c8fcf66\") "
Sep 11 13:51:41.889834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889656    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:41.889834 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:41.889964 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889913    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:51:41.890023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.889993    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20880b96-ab61-48e9-a543-f21c6c8fcf66-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.890023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.890007    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.890023 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.890016    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.890177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.890052    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.890177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.890067    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.891720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.891690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:51:41.891720 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.891697    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:41.891955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.891939    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf" (OuterVolumeSpecName: "kube-api-access-7q8sf") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "kube-api-access-7q8sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:51:41.892045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.892007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token" (OuterVolumeSpecName: "istio-token") pod "20880b96-ab61-48e9-a543-f21c6c8fcf66" (UID: "20880b96-ab61-48e9-a543-f21c6c8fcf66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:51:41.991218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.991173    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.991218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.991206    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.991218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.991215    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q8sf\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-kube-api-access-7q8sf\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:41.991218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:41.991226    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20880b96-ab61-48e9-a543-f21c6c8fcf66-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:42.154919 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:42.154837    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:51:42.157030 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:42.157008    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-4920fa-openshift-default-7ffdd57546-5w7vb"]
Sep 11 13:51:42.852377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:42.852346    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" path="/var/lib/kubelet/pods/20880b96-ab61-48e9-a543-f21c6c8fcf66/volumes"
Sep 11 13:51:47.797687 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:47.797652    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:51:47.798066 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:47.797926    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" podUID="5df49f00-f36e-4e22-9ae8-212a146cc64f" containerName="maas-api" containerID="cri-o://7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b" gracePeriod=30
Sep 11 13:51:47.899389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:47.899351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:48.009016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.008980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:48.057481 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.057422    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:51:48.151256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.151227    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtdt6\" (UniqueName: \"kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6\") pod \"5df49f00-f36e-4e22-9ae8-212a146cc64f\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") "
Sep 11 13:51:48.151423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.151296    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") pod \"5df49f00-f36e-4e22-9ae8-212a146cc64f\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") "
Sep 11 13:51:48.151423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.151367    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs\") pod \"5df49f00-f36e-4e22-9ae8-212a146cc64f\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") "
Sep 11 13:51:48.151423 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.151396    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca\") pod \"5df49f00-f36e-4e22-9ae8-212a146cc64f\" (UID: \"5df49f00-f36e-4e22-9ae8-212a146cc64f\") "
Sep 11 13:51:48.151862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.151823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5df49f00-f36e-4e22-9ae8-212a146cc64f" (UID: "5df49f00-f36e-4e22-9ae8-212a146cc64f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:51:48.154002 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.153978    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5df49f00-f36e-4e22-9ae8-212a146cc64f" (UID: "5df49f00-f36e-4e22-9ae8-212a146cc64f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:51:48.154115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.154020    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6" (OuterVolumeSpecName: "kube-api-access-rtdt6") pod "5df49f00-f36e-4e22-9ae8-212a146cc64f" (UID: "5df49f00-f36e-4e22-9ae8-212a146cc64f"). InnerVolumeSpecName "kube-api-access-rtdt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:51:48.154115 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.154087    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5df49f00-f36e-4e22-9ae8-212a146cc64f" (UID: "5df49f00-f36e-4e22-9ae8-212a146cc64f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:51:48.245878 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.245841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:48.253176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.253143    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtdt6\" (UniqueName: \"kubernetes.io/projected/5df49f00-f36e-4e22-9ae8-212a146cc64f-kube-api-access-rtdt6\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:48.253176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.253171    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-maas-api-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:48.253176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.253181    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5df49f00-f36e-4e22-9ae8-212a146cc64f-metrics-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:48.253374 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.253189    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5df49f00-f36e-4e22-9ae8-212a146cc64f-openshift-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:51:48.412038 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.411932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:48.799493 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.799466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:48.870024 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.870000    2582 generic.go:356] "Generic (PLEG): container finished" podID="5df49f00-f36e-4e22-9ae8-212a146cc64f" containerID="7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b" exitCode=0
Sep 11 13:51:48.870148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.870041    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"
Sep 11 13:51:48.870148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.870074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" event={"ID":"5df49f00-f36e-4e22-9ae8-212a146cc64f","Type":"ContainerDied","Data":"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"}
Sep 11 13:51:48.870148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.870120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6" event={"ID":"5df49f00-f36e-4e22-9ae8-212a146cc64f","Type":"ContainerDied","Data":"4f8db62d5e670e05b5702e0d0de59460c1eb19eb140d90fd99217cbd8559d988"}
Sep 11 13:51:48.870148 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.870146    2582 scope.go:117] "RemoveContainer" containerID="7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"
Sep 11 13:51:48.879306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.879291    2582 scope.go:117] "RemoveContainer" containerID="7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"
Sep 11 13:51:48.879634 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:51:48.879614    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b\": container with ID starting with 7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b not found: ID does not exist" containerID="7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"
Sep 11 13:51:48.879684 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.879643    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b"} err="failed to get container status \"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b\": rpc error: code = NotFound desc = could not find container \"7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b\": container with ID starting with 7539d901a31597fdceeb0ccd03515b1d656a3f886cbc3d333d29fc5bb528fc3b not found: ID does not exist"
Sep 11 13:51:48.932701 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.932679    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:51:48.947522 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:48.947492    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-9efb13-65ccbdf957-8ckl6"]
Sep 11 13:51:49.027756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:49.027710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:50.137547 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:50.137514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:50.853314 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:50.853279    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df49f00-f36e-4e22-9ae8-212a146cc64f" path="/var/lib/kubelet/pods/5df49f00-f36e-4e22-9ae8-212a146cc64f/volumes"
Sep 11 13:51:51.222551 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:51.222435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:54.883869 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:54.883832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:54.986518 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:54.986437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:55.194352 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:55.194263    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:51:55.194595 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:55.194570    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" containerID="cri-o://7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00" gracePeriod=30
Sep 11 13:51:55.207776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:55.207744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:56.619571 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:56.619535    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:51:56.619953 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:56.619628    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:51:56.771312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:56.771272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:57.601194 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:57.601160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:51:58.397586 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:51:58.397548    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:00.440216 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.440191    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:52:00.473604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473604 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473625    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473661    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473692    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473756 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473840    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmrpg\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg\") pod \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\" (UID: \"ec9c5278-8e8a-4656-8e1a-bc45626b28bc\") "
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473935    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:00.473963 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.473941    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474199    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474246    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474263    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474271    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.474290 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.474281    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.476052 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.476019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg" (OuterVolumeSpecName: "kube-api-access-pmrpg") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "kube-api-access-pmrpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:00.476312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.476291    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:00.476413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.476393    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:52:00.476413 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.476396    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec9c5278-8e8a-4656-8e1a-bc45626b28bc" (UID: "ec9c5278-8e8a-4656-8e1a-bc45626b28bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:00.575224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.575194    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.575224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.575218    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.575224 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.575228    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.575448 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.575235    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.575448 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.575243    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmrpg\" (UniqueName: \"kubernetes.io/projected/ec9c5278-8e8a-4656-8e1a-bc45626b28bc-kube-api-access-pmrpg\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:00.939959 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.939930    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerID="7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00" exitCode=0
Sep 11 13:52:00.940089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.939981    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"
Sep 11 13:52:00.940089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.940012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerDied","Data":"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"}
Sep 11 13:52:00.940089 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.940070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6" event={"ID":"ec9c5278-8e8a-4656-8e1a-bc45626b28bc","Type":"ContainerDied","Data":"41f70b82ed8473b00d81d44c82c1c15ca8abd21bfbf77e8a683753bb97f1d5af"}
Sep 11 13:52:00.940208 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.940100    2582 scope.go:117] "RemoveContainer" containerID="7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"
Sep 11 13:52:00.948909 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.948892    2582 scope.go:117] "RemoveContainer" containerID="16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"
Sep 11 13:52:00.956939 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.956919    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:52:00.957011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.956943    2582 scope.go:117] "RemoveContainer" containerID="7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"
Sep 11 13:52:00.957233 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:52:00.957214    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00\": container with ID starting with 7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00 not found: ID does not exist" containerID="7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"
Sep 11 13:52:00.957295 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.957250    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00"} err="failed to get container status \"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00\": rpc error: code = NotFound desc = could not find container \"7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00\": container with ID starting with 7553f43ac27f05462d55e4f7aa2211a2b12374dee13d1658bb82ca4c70762f00 not found: ID does not exist"
Sep 11 13:52:00.957295 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.957274    2582 scope.go:117] "RemoveContainer" containerID="16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"
Sep 11 13:52:00.957550 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:52:00.957532    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6\": container with ID starting with 16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6 not found: ID does not exist" containerID="16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"
Sep 11 13:52:00.957608 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.957561    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6"} err="failed to get container status \"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6\": rpc error: code = NotFound desc = could not find container \"16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6\": container with ID starting with 16055453d371480186baaaa182ba4aea8c705f862db60c9946c2e8dd59f41dc6 not found: ID does not exist"
Sep 11 13:52:00.960460 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:00.960439    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9efb13-openshift-default-cbccb49b4-8vfm6"]
Sep 11 13:52:02.852487 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:02.852452    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" path="/var/lib/kubelet/pods/ec9c5278-8e8a-4656-8e1a-bc45626b28bc/volumes"
Sep 11 13:52:06.168455 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.168420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:06.245090 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.245054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:06.345172 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.345136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:06.421823 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.421732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:06.670064 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.670028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:06.852153 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:06.852119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:07.684833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:07.684797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:08.727989 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:08.727896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:14.526471 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:14.526434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:14.635037 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:14.635005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:14.838925 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:14.838838    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:52:14.839121 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:14.839095    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy" containerID="cri-o://c62ab05a6ecf85488598f2db48e267b6b40b93e0588bc6b747ad07448285733b" gracePeriod=30
Sep 11 13:52:14.886591 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:14.886562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:15.512256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:15.512224    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:16.604176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:16.604136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:17.842524 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:17.842463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:20.049778 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.049746    2582 generic.go:356] "Generic (PLEG): container finished" podID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerID="c62ab05a6ecf85488598f2db48e267b6b40b93e0588bc6b747ad07448285733b" exitCode=0
Sep 11 13:52:20.050218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.049808    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerDied","Data":"c62ab05a6ecf85488598f2db48e267b6b40b93e0588bc6b747ad07448285733b"}
Sep 11 13:52:20.050218 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.049858    2582 scope.go:117] "RemoveContainer" containerID="7d687d5d0a346855c984d94d1598178fc5006ed8a90e7e73e3e43891ad6eec88"
Sep 11 13:52:20.090926 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.090904    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:52:20.171236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171154    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171201    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171234    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171260    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171285    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171337    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8srms\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171530 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171494    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:20.171843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token\") pod \"528d7aab-026f-4dc8-8b48-588dfc15c6af\" (UID: \"528d7aab-026f-4dc8-8b48-588dfc15c6af\") "
Sep 11 13:52:20.171843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171630    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data" (OuterVolumeSpecName: "istio-data") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:20.171843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171639    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:20.171843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171745    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:20.171843 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171768    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:52:20.172059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171938    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.172059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171956    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/528d7aab-026f-4dc8-8b48-588dfc15c6af-istiod-ca-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.172059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171968    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-data\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.172059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171981    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-credential-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.172059 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.171993    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-workload-socket\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.173674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.173647    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:20.173795 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.173704    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms" (OuterVolumeSpecName: "kube-api-access-8srms") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "kube-api-access-8srms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:20.173985 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.173971    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token" (OuterVolumeSpecName: "istio-token") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:20.174026 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.173999    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "528d7aab-026f-4dc8-8b48-588dfc15c6af" (UID: "528d7aab-026f-4dc8-8b48-588dfc15c6af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:52:20.272730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.272687    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8srms\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-kube-api-access-8srms\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.272730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.272720    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-token\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.272730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.272731    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-podinfo\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:20.272730 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:20.272739    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/528d7aab-026f-4dc8-8b48-588dfc15c6af-istio-envoy\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:21.057281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:21.057251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"
Sep 11 13:52:21.057281 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:21.057276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c" event={"ID":"528d7aab-026f-4dc8-8b48-588dfc15c6af","Type":"ContainerDied","Data":"23421fe4f83ce4cad3936671bb9b0ba4a81c79d309f505f918df8eff5114834d"}
Sep 11 13:52:21.057780 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:21.057330    2582 scope.go:117] "RemoveContainer" containerID="c62ab05a6ecf85488598f2db48e267b6b40b93e0588bc6b747ad07448285733b"
Sep 11 13:52:21.084802 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:21.084774    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:52:21.090045 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:21.090018    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3dd80c-openshift-default-7d47b9bd9b-jpq7c"]
Sep 11 13:52:22.853003 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:22.852967    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" path="/var/lib/kubelet/pods/528d7aab-026f-4dc8-8b48-588dfc15c6af/volumes"
Sep 11 13:52:26.111551 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.111517    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"]
Sep 11 13:52:26.112012 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.111990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:26.115983 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.115955    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6ca2b-29818905-4bjk8"]
Sep 11 13:52:26.205901 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.205873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:26.314887 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.314855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:26.420715 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.420615    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:26.546369 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.546339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:26.853247 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.853218    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c622c5-f9a8-485a-92e8-fd9b16cea378" path="/var/lib/kubelet/pods/77c622c5-f9a8-485a-92e8-fd9b16cea378/volumes"
Sep 11 13:52:26.929751 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:26.929716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:27.021258 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:27.021221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:33.216168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:33.216135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:33.802182 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:33.802155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:33.994020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:33.993987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:34.230452 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:34.230373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:37.373833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.373793    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:52:37.374255 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.374030    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58558d56b9-x5rf5" podUID="7f1744fd-d112-4b95-8387-e68fdac79d07" containerName="manager" containerID="cri-o://02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc" gracePeriod=30
Sep 11 13:52:37.630636 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.630584    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:52:37.642360 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.642341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs\") pod \"7f1744fd-d112-4b95-8387-e68fdac79d07\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") "
Sep 11 13:52:37.642434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.642370    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") pod \"7f1744fd-d112-4b95-8387-e68fdac79d07\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") "
Sep 11 13:52:37.642434 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.642401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9826\" (UniqueName: \"kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826\") pod \"7f1744fd-d112-4b95-8387-e68fdac79d07\" (UID: \"7f1744fd-d112-4b95-8387-e68fdac79d07\") "
Sep 11 13:52:37.644448 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.644418    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7f1744fd-d112-4b95-8387-e68fdac79d07" (UID: "7f1744fd-d112-4b95-8387-e68fdac79d07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:37.644568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.644444    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7f1744fd-d112-4b95-8387-e68fdac79d07" (UID: "7f1744fd-d112-4b95-8387-e68fdac79d07"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:37.644568 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.644465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826" (OuterVolumeSpecName: "kube-api-access-d9826") pod "7f1744fd-d112-4b95-8387-e68fdac79d07" (UID: "7f1744fd-d112-4b95-8387-e68fdac79d07"). InnerVolumeSpecName "kube-api-access-d9826". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:37.743871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.743843    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-metrics-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:37.743871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.743868    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f1744fd-d112-4b95-8387-e68fdac79d07-webhook-cert\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:37.743871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:37.743879    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9826\" (UniqueName: \"kubernetes.io/projected/7f1744fd-d112-4b95-8387-e68fdac79d07-kube-api-access-d9826\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:52:38.151168 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.151133    2582 generic.go:356] "Generic (PLEG): container finished" podID="7f1744fd-d112-4b95-8387-e68fdac79d07" containerID="02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc" exitCode=0
Sep 11 13:52:38.151377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.151188    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58558d56b9-x5rf5"
Sep 11 13:52:38.151377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.151203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58558d56b9-x5rf5" event={"ID":"7f1744fd-d112-4b95-8387-e68fdac79d07","Type":"ContainerDied","Data":"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"}
Sep 11 13:52:38.151377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.151252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58558d56b9-x5rf5" event={"ID":"7f1744fd-d112-4b95-8387-e68fdac79d07","Type":"ContainerDied","Data":"f4cf7f97d420311477dbdaa222661bc07ebe65c818021b6259ef8fc84f4fb3bc"}
Sep 11 13:52:38.151377 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.151275    2582 scope.go:117] "RemoveContainer" containerID="02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"
Sep 11 13:52:38.161428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.161413    2582 scope.go:117] "RemoveContainer" containerID="02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"
Sep 11 13:52:38.161711 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:52:38.161694    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc\": container with ID starting with 02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc not found: ID does not exist" containerID="02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"
Sep 11 13:52:38.161762 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.161719    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc"} err="failed to get container status \"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc\": rpc error: code = NotFound desc = could not find container \"02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc\": container with ID starting with 02ef2fbb6fab9e1b139f352ea3e37bac6ebcd1d2b44b79624b5151f84ff28edc not found: ID does not exist"
Sep 11 13:52:38.185315 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.185291    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:52:38.188155 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.188135    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58558d56b9-x5rf5"]
Sep 11 13:52:38.852456 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:38.852425    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1744fd-d112-4b95-8387-e68fdac79d07" path="/var/lib/kubelet/pods/7f1744fd-d112-4b95-8387-e68fdac79d07/volumes"
Sep 11 13:52:46.922698 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:46.922669    2582 scope.go:117] "RemoveContainer" containerID="4414aa0021d2564d419e93d80ef5a0851fdabc2647aff6662aec774ab25a20b0"
Sep 11 13:52:52.576580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:52.576544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:52:52.668279 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:52:52.668247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:53:59.109884 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:53:59.109847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:54:00.741943 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:54:00.741911    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:54:50.995020 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:54:50.994979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:55:25.326262 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:55:25.326222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:55:35.167810 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:55:35.167770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:56:46.928151 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:56:46.928112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:57:04.442806 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.442770    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443192    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443204    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443212    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443218    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443227    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443232    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443239    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443244    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443252    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443257    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443264    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df49f00-f36e-4e22-9ae8-212a146cc64f" containerName="maas-api"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443269    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df49f00-f36e-4e22-9ae8-212a146cc64f" containerName="maas-api"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443282    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1744fd-d112-4b95-8387-e68fdac79d07" containerName="manager"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443288    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1744fd-d112-4b95-8387-e68fdac79d07" containerName="manager"
Sep 11 13:57:04.443285 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443293    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443305    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443310    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443329    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443335    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443395    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443403    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443408    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443417    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df49f00-f36e-4e22-9ae8-212a146cc64f" containerName="maas-api"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443422    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443428    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9c5278-8e8a-4656-8e1a-bc45626b28bc" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443433    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d90fa1-346c-43b0-99c8-dc1a9e345d08" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443438    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="528d7aab-026f-4dc8-8b48-588dfc15c6af" containerName="istio-proxy"
Sep 11 13:57:04.443776 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.443442    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1744fd-d112-4b95-8387-e68fdac79d07" containerName="manager"
Sep 11 13:57:04.446694 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.446676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.449646 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.449629    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9fe19763-kserve-self-signed-certs\""
Sep 11 13:57:04.462441 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.462417    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:04.522458 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.522409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:57:04.543176 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.543306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.543306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.543306 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q427t\" (UniqueName: \"kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.543445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.543445 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.543365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644542 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q427t\" (UniqueName: \"kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.644754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.644687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.645106 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.645070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.645234 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.645124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.645234 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.645150    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.646871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.646845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.647264 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.647242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.666335 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.666313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q427t\" (UniqueName: \"kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t\") pod \"e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") " pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:04.770955 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:04.770872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:05.069282 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:05.069238    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:05.072144 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:57:05.072100    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0573664_406f_4c32_a892_d79a406dd69e.slice/crio-40f2503f3fcdbcad6629e3e961827a21985ed7e61eb0997696fab9fe475a8f63 WatchSource:0}: Error finding container 40f2503f3fcdbcad6629e3e961827a21985ed7e61eb0997696fab9fe475a8f63: Status 404 returned error can't find the container with id 40f2503f3fcdbcad6629e3e961827a21985ed7e61eb0997696fab9fe475a8f63
Sep 11 13:57:05.503876 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:05.503779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" event={"ID":"d0573664-406f-4c32-a892-d79a406dd69e","Type":"ContainerStarted","Data":"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"}
Sep 11 13:57:05.503876 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:05.503821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" event={"ID":"d0573664-406f-4c32-a892-d79a406dd69e","Type":"ContainerStarted","Data":"40f2503f3fcdbcad6629e3e961827a21985ed7e61eb0997696fab9fe475a8f63"}
Sep 11 13:57:05.525759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:05.525708    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" podStartSLOduration=1.52569247 podStartE2EDuration="1.52569247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:57:05.52390607 +0000 UTC m=+2239.356341208" watchObservedRunningTime="2026-09-11 13:57:05.52569247 +0000 UTC m=+2239.358127613"
Sep 11 13:57:14.771531 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:14.771422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:14.771531 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:14.771482    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:14.783996 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:14.783970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:15.564695 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:15.564668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:29.498708 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:29.498674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:57:30.344518 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:30.344469    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:30.365862 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:30.365835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:57:45.363849 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.363805    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" podUID="d0573664-406f-4c32-a892-d79a406dd69e" containerName="main" containerID="cri-o://0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07" gracePeriod=45
Sep 11 13:57:45.620308 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.620251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:45.646560 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q427t\" (UniqueName: \"kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646691 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646914 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs\") pod \"d0573664-406f-4c32-a892-d79a406dd69e\" (UID: \"d0573664-406f-4c32-a892-d79a406dd69e\") "
Sep 11 13:57:45.646968 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646944    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:57:45.646968 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646956    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home" (OuterVolumeSpecName: "home") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:57:45.647057 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.646976    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:57:45.647103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.647079    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-tmp-dir\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:45.647103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.647097    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-model-cache\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:45.647209 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.647109    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-home\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:45.648780 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.648748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm" (OuterVolumeSpecName: "dshm") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:57:45.648885 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.648779    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:57:45.648885 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.648802    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t" (OuterVolumeSpecName: "kube-api-access-q427t") pod "d0573664-406f-4c32-a892-d79a406dd69e" (UID: "d0573664-406f-4c32-a892-d79a406dd69e"). InnerVolumeSpecName "kube-api-access-q427t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:57:45.706971 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.706940    2582 generic.go:356] "Generic (PLEG): container finished" podID="d0573664-406f-4c32-a892-d79a406dd69e" containerID="0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07" exitCode=0
Sep 11 13:57:45.707130 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.706983    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"
Sep 11 13:57:45.707130 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.707026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" event={"ID":"d0573664-406f-4c32-a892-d79a406dd69e","Type":"ContainerDied","Data":"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"}
Sep 11 13:57:45.707130 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.707073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" event={"ID":"d0573664-406f-4c32-a892-d79a406dd69e","Type":"ContainerDied","Data":"40f2503f3fcdbcad6629e3e961827a21985ed7e61eb0997696fab9fe475a8f63"}
Sep 11 13:57:45.707130 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.707095    2582 scope.go:117] "RemoveContainer" containerID="0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"
Sep 11 13:57:45.716053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.716037    2582 scope.go:117] "RemoveContainer" containerID="0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"
Sep 11 13:57:45.716350 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:57:45.716331    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07\": container with ID starting with 0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07 not found: ID does not exist" containerID="0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"
Sep 11 13:57:45.716396 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.716358    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07"} err="failed to get container status \"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07\": rpc error: code = NotFound desc = could not find container \"0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07\": container with ID starting with 0b169789bc4916dfb20b1721fc589b57db6bb925e40858631f67e53e6584ab07 not found: ID does not exist"
Sep 11 13:57:45.734601 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.734573    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:45.742549 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.742525    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb"]
Sep 11 13:57:45.748365 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.748349    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0573664-406f-4c32-a892-d79a406dd69e-dshm\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:45.748449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.748367    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0573664-406f-4c32-a892-d79a406dd69e-tls-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:45.748449 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:45.748377    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q427t\" (UniqueName: \"kubernetes.io/projected/d0573664-406f-4c32-a892-d79a406dd69e-kube-api-access-q427t\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:57:46.852016 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:46.851984    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0573664-406f-4c32-a892-d79a406dd69e" path="/var/lib/kubelet/pods/d0573664-406f-4c32-a892-d79a406dd69e/volumes"
Sep 11 13:57:50.554833 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:50.554782    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-b-9fe19763-kserve-8cc86d5c9-9pkzb" podUID="d0573664-406f-4c32-a892-d79a406dd69e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:57:52.324859 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:52.324825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:57:53.150911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.150877    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"]
Sep 11 13:57:53.151297 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.151285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0573664-406f-4c32-a892-d79a406dd69e" containerName="main"
Sep 11 13:57:53.151355 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.151299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0573664-406f-4c32-a892-d79a406dd69e" containerName="main"
Sep 11 13:57:53.151392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.151380    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0573664-406f-4c32-a892-d79a406dd69e" containerName="main"
Sep 11 13:57:53.151392 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.151391    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20880b96-ab61-48e9-a543-f21c6c8fcf66" containerName="istio-proxy"
Sep 11 13:57:53.154593 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.154575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.169964 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.169938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"]
Sep 11 13:57:53.227093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.227061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-maas-api-tls\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.227299 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.227115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/690512e6-8db2-46bc-85e6-b794758577ff-openshift-service-ca\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.227299 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.227145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-metrics-certs\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.227299 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.227208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvb68\" (UniqueName: \"kubernetes.io/projected/690512e6-8db2-46bc-85e6-b794758577ff-kube-api-access-vvb68\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.327780 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.327737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-maas-api-tls\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.328259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.327816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/690512e6-8db2-46bc-85e6-b794758577ff-openshift-service-ca\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.328259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.327856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-metrics-certs\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.328259 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.327909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvb68\" (UniqueName: \"kubernetes.io/projected/690512e6-8db2-46bc-85e6-b794758577ff-kube-api-access-vvb68\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.328550 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.328496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/690512e6-8db2-46bc-85e6-b794758577ff-openshift-service-ca\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.330279 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.330256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-metrics-certs\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.330435 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.330415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/690512e6-8db2-46bc-85e6-b794758577ff-maas-api-tls\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.337383 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.337358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvb68\" (UniqueName: \"kubernetes.io/projected/690512e6-8db2-46bc-85e6-b794758577ff-kube-api-access-vvb68\") pod \"maas-api-5ccdf6b696-88fb8\" (UID: \"690512e6-8db2-46bc-85e6-b794758577ff\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.464660 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.464564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:53.742301 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.742274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"]
Sep 11 13:57:53.744151 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:57:53.744119    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690512e6_8db2_46bc_85e6_b794758577ff.slice/crio-37bc69381d0c4fdf86416aa65344162704ad9a246db1f239af0fbdb5adbb1032 WatchSource:0}: Error finding container 37bc69381d0c4fdf86416aa65344162704ad9a246db1f239af0fbdb5adbb1032: Status 404 returned error can't find the container with id 37bc69381d0c4fdf86416aa65344162704ad9a246db1f239af0fbdb5adbb1032
Sep 11 13:57:53.745453 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.745433    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:57:53.751718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:53.751691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8" event={"ID":"690512e6-8db2-46bc-85e6-b794758577ff","Type":"ContainerStarted","Data":"37bc69381d0c4fdf86416aa65344162704ad9a246db1f239af0fbdb5adbb1032"}
Sep 11 13:57:54.758532 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:54.758458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8" event={"ID":"690512e6-8db2-46bc-85e6-b794758577ff","Type":"ContainerStarted","Data":"cf9f25639cba0a2fb88457a13525de5588470e24f638f403bf2283428ba63b4b"}
Sep 11 13:57:54.758923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:54.758554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:57:54.789103 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:57:54.789045    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8" podStartSLOduration=1.393327226 podStartE2EDuration="1.789026524s" totalImagesPullingTime="395.699298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:57:54.787829981 +0000 UTC m=+2288.620265143" watchObservedRunningTime="2026-09-11 13:57:54.789026524 +0000 UTC m=+2288.621461664"
Sep 11 13:58:00.768322 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:00.768285    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-88fb8"
Sep 11 13:58:08.294105 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:08.294062    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:58:08.294578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:08.294301    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerName="maas-api" containerID="cri-o://581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb" gracePeriod=30
Sep 11 13:58:08.989312 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:08.989270    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.35:8443/health\": dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 11 13:58:09.542033 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.542009    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:58:09.693871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.693785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs\") pod \"61d3304c-2c33-4115-b3cf-d486fa01261d\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") "
Sep 11 13:58:09.693871 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.693852    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls\") pod \"61d3304c-2c33-4115-b3cf-d486fa01261d\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") "
Sep 11 13:58:09.694098 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.693967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sncp4\" (UniqueName: \"kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4\") pod \"61d3304c-2c33-4115-b3cf-d486fa01261d\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") "
Sep 11 13:58:09.694157 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.694108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca\") pod \"61d3304c-2c33-4115-b3cf-d486fa01261d\" (UID: \"61d3304c-2c33-4115-b3cf-d486fa01261d\") "
Sep 11 13:58:09.694558 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.694531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61d3304c-2c33-4115-b3cf-d486fa01261d" (UID: "61d3304c-2c33-4115-b3cf-d486fa01261d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:58:09.696112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.696092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "61d3304c-2c33-4115-b3cf-d486fa01261d" (UID: "61d3304c-2c33-4115-b3cf-d486fa01261d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:58:09.696166 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.696141    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61d3304c-2c33-4115-b3cf-d486fa01261d" (UID: "61d3304c-2c33-4115-b3cf-d486fa01261d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:58:09.696204 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.696184    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4" (OuterVolumeSpecName: "kube-api-access-sncp4") pod "61d3304c-2c33-4115-b3cf-d486fa01261d" (UID: "61d3304c-2c33-4115-b3cf-d486fa01261d"). InnerVolumeSpecName "kube-api-access-sncp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:58:09.795580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.795541    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d3304c-2c33-4115-b3cf-d486fa01261d-openshift-service-ca\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:58:09.795580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.795574    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-metrics-certs\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:58:09.795580 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.795588    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d3304c-2c33-4115-b3cf-d486fa01261d-maas-api-tls\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:58:09.795813 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.795599    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sncp4\" (UniqueName: \"kubernetes.io/projected/61d3304c-2c33-4115-b3cf-d486fa01261d-kube-api-access-sncp4\") on node \"ip-10-0-132-92.ec2.internal\" DevicePath \"\""
Sep 11 13:58:09.840008 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.839973    2582 generic.go:356] "Generic (PLEG): container finished" podID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerID="581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb" exitCode=0
Sep 11 13:58:09.840146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.840024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"
Sep 11 13:58:09.840146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.840039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" event={"ID":"61d3304c-2c33-4115-b3cf-d486fa01261d","Type":"ContainerDied","Data":"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"}
Sep 11 13:58:09.840146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.840096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5" event={"ID":"61d3304c-2c33-4115-b3cf-d486fa01261d","Type":"ContainerDied","Data":"b8cbc1de69b826d14b8e80cdf19eb02a51fe9c28df086b02fc2e849d12279c93"}
Sep 11 13:58:09.840146 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.840126    2582 scope.go:117] "RemoveContainer" containerID="581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"
Sep 11 13:58:09.849578 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.849559    2582 scope.go:117] "RemoveContainer" containerID="581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"
Sep 11 13:58:09.849854 ip-10-0-132-92 kubenswrapper[2582]: E0911 13:58:09.849835    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb\": container with ID starting with 581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb not found: ID does not exist" containerID="581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"
Sep 11 13:58:09.849907 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.849864    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb"} err="failed to get container status \"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb\": rpc error: code = NotFound desc = could not find container \"581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb\": container with ID starting with 581efb871d314974e30da5b7132180ad33d79e601cfe5f8ca8152e9c373936bb not found: ID does not exist"
Sep 11 13:58:09.865288 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.865258    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:58:09.869850 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:09.869826    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-qqdx5"]
Sep 11 13:58:10.851823 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:10.851786    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" path="/var/lib/kubelet/pods/61d3304c-2c33-4115-b3cf-d486fa01261d/volumes"
Sep 11 13:58:29.441318 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:29.441272    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8wnv6_987a710f-099f-49b2-974e-fc56da6bac79/manager/0.log"
Sep 11 13:58:29.977668 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:29.977622    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbpmf_e0154221-3ef5-471f-9d9d-a8cc06b87811/manager/0.log"
Sep 11 13:58:30.097083 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:30.097055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-dt9qd_3abf4212-026c-4438-9f73-9f13331a6bb2/copy-manifests/0.log"
Sep 11 13:58:30.109882 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:30.109855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-dt9qd_3abf4212-026c-4438-9f73-9f13331a6bb2/manager/0.log"
Sep 11 13:58:30.802389 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:30.802365    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ccdf6b696-88fb8_690512e6-8db2-46bc-85e6-b794758577ff/maas-api/0.log"
Sep 11 13:58:31.082650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:31.082567    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818905-zsgdl_cff6ed21-5341-4be5-9b39-d54423045fa1/cleanup/0.log"
Sep 11 13:58:31.216749 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:31.216719    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-q88lq_1986e35f-c383-4ab7-bbf9-f12abc0ea1cb/postgres/0.log"
Sep 11 13:58:32.300158 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:32.300121    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-5c2vq_4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2/manager/0.log"
Sep 11 13:58:33.357100 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:33.357071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj_533b3ae4-e172-4579-ac3e-f6ae87f36dd9/istio-proxy/0.log"
Sep 11 13:58:33.873994 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:33.873966    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/1.log"
Sep 11 13:58:34.243517 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:34.243430    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cbfcdc64b-9rglm_563d51ca-738f-4f55-b006-aa87c7d5c104/router/0.log"
Sep 11 13:58:34.619380 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:34.619339    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-k8qmf_7116815b-c3a8-4653-b390-4b0071ab347e/main/0.log"
Sep 11 13:58:34.880714 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:34.880639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-vwbvc_fcfc0db9-f4ed-4765-88d8-6bf15457d76b/main/0.log"
Sep 11 13:58:35.013464 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:35.013435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4pm2d_e4e0575c-c13b-417b-912a-b14244128839/main/0.log"
Sep 11 13:58:35.281490 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:35.281462    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tfxw2_3953deec-b641-4e1f-92a1-6cc355a5d725/main/0.log"
Sep 11 13:58:42.349006 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:42.348922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:58:42.454451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:42.454416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log" limit=1024
Sep 11 13:58:45.572820 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:45.572790    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-csggs_e8a3c897-9e78-4ee7-9f7b-c32a5adba1e5/global-pull-secret-syncer/0.log"
Sep 11 13:58:45.748053 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:45.748025    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6fmz4_c1439a13-ea3d-4fd4-80ac-e1d6b933c5c3/konnectivity-agent/0.log"
Sep 11 13:58:45.853923 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:45.853851    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-92.ec2.internal_7dd1428d7a8ed86935288a6878be4d6d/haproxy/0.log"
Sep 11 13:58:50.889799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:50.889760    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-5c2vq_4b95734e-d668-4cd8-bb15-9c1f0ef8a1c2/manager/0.log"
Sep 11 13:58:52.626640 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.626605    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/alertmanager/0.log"
Sep 11 13:58:52.657451 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.657424    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/config-reloader/0.log"
Sep 11 13:58:52.685319 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.685286    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/kube-rbac-proxy-web/0.log"
Sep 11 13:58:52.711201 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.711178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/kube-rbac-proxy/0.log"
Sep 11 13:58:52.739697 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.739648    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/kube-rbac-proxy-metric/0.log"
Sep 11 13:58:52.763331 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.763303    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/prom-label-proxy/0.log"
Sep 11 13:58:52.788184 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.788157    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9841c4e0-b0b2-41b8-9d99-247cb0748880/init-config-reloader/0.log"
Sep 11 13:58:52.957803 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:52.957775    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6788766cc4-v8vxf_ff0504bb-9d84-4d9d-9adb-492c5bbd66f4/metrics-server/0.log"
Sep 11 13:58:53.042911 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.042837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mfrp_0f1fece1-c276-4260-8074-04656cff759a/node-exporter/0.log"
Sep 11 13:58:53.070420 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.070372    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mfrp_0f1fece1-c276-4260-8074-04656cff759a/kube-rbac-proxy/0.log"
Sep 11 13:58:53.098064 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.098037    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mfrp_0f1fece1-c276-4260-8074-04656cff759a/init-textfile/0.log"
Sep 11 13:58:53.465384 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.465350    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/prometheus/0.log"
Sep 11 13:58:53.489165 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.489123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/config-reloader/0.log"
Sep 11 13:58:53.516889 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.516860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/thanos-sidecar/0.log"
Sep 11 13:58:53.548800 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.548773    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/kube-rbac-proxy-web/0.log"
Sep 11 13:58:53.575229 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.575202    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/kube-rbac-proxy/0.log"
Sep 11 13:58:53.604203 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.604178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/kube-rbac-proxy-thanos/0.log"
Sep 11 13:58:53.628266 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.628241    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_017711e3-477b-4b0e-8e2c-3a3b65d2090f/init-config-reloader/0.log"
Sep 11 13:58:53.660376 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.660349    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-fsmvx_ba054409-9d22-4696-ae83-6a114cda177c/prometheus-operator/0.log"
Sep 11 13:58:53.683271 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.683204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-fsmvx_ba054409-9d22-4696-ae83-6a114cda177c/kube-rbac-proxy/0.log"
Sep 11 13:58:53.848424 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.848394    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/thanos-query/0.log"
Sep 11 13:58:53.877545 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.877520    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/kube-rbac-proxy-web/0.log"
Sep 11 13:58:53.916900 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.916874    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/kube-rbac-proxy/0.log"
Sep 11 13:58:53.949944 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.949868    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/prom-label-proxy/0.log"
Sep 11 13:58:53.977391 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:53.977368    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/kube-rbac-proxy-rules/0.log"
Sep 11 13:58:54.014754 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:54.014725    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f6c5f5fb8-m257h_fbfea1bb-c613-4698-ace9-490e8ca8bc48/kube-rbac-proxy-metrics/0.log"
Sep 11 13:58:55.348510 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.348466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-w7rvc_d81c9284-9707-4425-aada-58fc212ab9a5/networking-console-plugin/0.log"
Sep 11 13:58:55.943340 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.943304    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"]
Sep 11 13:58:55.943748 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.943735    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerName="maas-api"
Sep 11 13:58:55.943799 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.943750    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerName="maas-api"
Sep 11 13:58:55.943835 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.943811    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d3304c-2c33-4115-b3cf-d486fa01261d" containerName="maas-api"
Sep 11 13:58:55.947175 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.947150    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:55.953062 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.953043    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9fc22\"/\"default-dockercfg-jx2lb\""
Sep 11 13:58:55.953970 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.953860    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fc22\"/\"kube-root-ca.crt\""
Sep 11 13:58:55.957112 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.957092    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fc22\"/\"openshift-service-ca.crt\""
Sep 11 13:58:55.977378 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:55.977340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"]
Sep 11 13:58:56.047011 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.046973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-sys\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.047185 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.047027    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62pwt\" (UniqueName: \"kubernetes.io/projected/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-kube-api-access-62pwt\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.047185 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.047049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-proc\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.047185 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.047150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-podres\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.047304 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.047221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-lib-modules\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62pwt\" (UniqueName: \"kubernetes.io/projected/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-kube-api-access-62pwt\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148120 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-proc\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-podres\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-lib-modules\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-proc\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-sys\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148388 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-sys\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148624 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-podres\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.148624 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.148401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-lib-modules\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.157431 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.157411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62pwt\" (UniqueName: \"kubernetes.io/projected/f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d-kube-api-access-62pwt\") pod \"perf-node-gather-daemonset-wptnh\" (UID: \"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.258236 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.258156    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:56.533563 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:56.533534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"]
Sep 11 13:58:56.534653 ip-10-0-132-92 kubenswrapper[2582]: W0911 13:58:56.534620    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3c3fb9d_e53e_4a57_b1ce_f6511d8b6a1d.slice/crio-4f6c09316424162fda4185f08bfff49d6653d0fe047dccc9c7db35831538e459 WatchSource:0}: Error finding container 4f6c09316424162fda4185f08bfff49d6653d0fe047dccc9c7db35831538e459: Status 404 returned error can't find the container with id 4f6c09316424162fda4185f08bfff49d6653d0fe047dccc9c7db35831538e459
Sep 11 13:58:57.078680 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:57.078644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh" event={"ID":"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d","Type":"ContainerStarted","Data":"9d2d950626b21c7f48be16e03f6c41242a5442b52523bdad3eb394af00ba3273"}
Sep 11 13:58:57.078888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:57.078701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh" event={"ID":"f3c3fb9d-e53e-4a57-b1ce-f6511d8b6a1d","Type":"ContainerStarted","Data":"4f6c09316424162fda4185f08bfff49d6653d0fe047dccc9c7db35831538e459"}
Sep 11 13:58:57.078888 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:57.078776    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:58:57.098674 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:57.098624    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh" podStartSLOduration=2.098608645 podStartE2EDuration="2.098608645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:58:57.097096485 +0000 UTC m=+2350.929531625" watchObservedRunningTime="2026-09-11 13:58:57.098608645 +0000 UTC m=+2350.931043783"
Sep 11 13:58:58.570096 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:58.570070    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbmkd_6ba1b359-cd4e-445e-8c41-8eb1f504e814/dns/0.log"
Sep 11 13:58:58.597318 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:58.597291    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbmkd_6ba1b359-cd4e-445e-8c41-8eb1f504e814/kube-rbac-proxy/0.log"
Sep 11 13:58:58.790093 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:58.790064    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5kb6_b8879b2c-2e02-422e-aea0-3c32776bb894/dns-node-resolver/0.log"
Sep 11 13:58:59.473342 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:59.473311    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5dd664d6-l9v4p_967c4de4-e4ab-4bc7-9c41-5c226effaea2/registry/0.log"
Sep 11 13:58:59.574444 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:58:59.574409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wx27l_5b3160f1-4933-46df-adff-207d0becf29a/node-ca/0.log"
Sep 11 13:59:00.626424 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:00.626391    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj_533b3ae4-e172-4579-ac3e-f6ae87f36dd9/istio-proxy/0.log"
Sep 11 13:59:01.055428 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:01.055399    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/0.log"
Sep 11 13:59:01.062616 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:01.062597    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/1.log"
Sep 11 13:59:01.165230 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:01.165202    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cbfcdc64b-9rglm_563d51ca-738f-4f55-b006-aa87c7d5c104/router/0.log"
Sep 11 13:59:02.171658 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:02.171626    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cshr4_cac16b1d-9d3d-4856-a189-e9eafad2e4b6/serve-healthcheck-canary/0.log"
Sep 11 13:59:02.784532 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:02.784487    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-p45fg_1fafe594-936f-40ba-9709-a7073fe1c18a/insights-operator/0.log"
Sep 11 13:59:02.785177 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:02.785159    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-p45fg_1fafe594-936f-40ba-9709-a7073fe1c18a/insights-operator/1.log"
Sep 11 13:59:02.938724 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:02.938699    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh5vk_abc29b0f-3fed-4259-a320-b5e50b74b6cc/kube-rbac-proxy/0.log"
Sep 11 13:59:02.972934 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:02.972906    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh5vk_abc29b0f-3fed-4259-a320-b5e50b74b6cc/exporter/0.log"
Sep 11 13:59:03.006367 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:03.006327    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh5vk_abc29b0f-3fed-4259-a320-b5e50b74b6cc/extractor/0.log"
Sep 11 13:59:03.094622 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:03.094539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-wptnh"
Sep 11 13:59:06.275759 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:06.275733    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8wnv6_987a710f-099f-49b2-974e-fc56da6bac79/manager/0.log"
Sep 11 13:59:06.766718 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:06.766690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbpmf_e0154221-3ef5-471f-9d9d-a8cc06b87811/manager/0.log"
Sep 11 13:59:06.929302 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:06.929265    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-dt9qd_3abf4212-026c-4438-9f73-9f13331a6bb2/manager/0.log"
Sep 11 13:59:06.985256 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:06.985230    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-dt9qd_3abf4212-026c-4438-9f73-9f13331a6bb2/copy-manifests/0.log"
Sep 11 13:59:07.287990 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:07.287963    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj_533b3ae4-e172-4579-ac3e-f6ae87f36dd9/istio-proxy/0.log"
Sep 11 13:59:07.669235 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:07.669149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/0.log"
Sep 11 13:59:07.678482 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:07.678454    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/1.log"
Sep 11 13:59:07.903307 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:07.903277    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cbfcdc64b-9rglm_563d51ca-738f-4f55-b006-aa87c7d5c104/router/0.log"
Sep 11 13:59:08.755650 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:08.755617    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75ffb8c58-nrwd7_961f93a7-f2a5-4fdc-8259-732972f2294b/manager/0.log"
Sep 11 13:59:09.513399 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:09.513369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fwzhj_533b3ae4-e172-4579-ac3e-f6ae87f36dd9/istio-proxy/0.log"
Sep 11 13:59:09.932707 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:09.932674    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/0.log"
Sep 11 13:59:09.940769 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:09.940744    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wgtg9_56339ef8-4199-4434-b47b-e27f01c87a76/istio-proxy/1.log"
Sep 11 13:59:10.050761 ip-10-0-132-92 kubenswrapper[2582]: I0911 13:59:10.050731    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cbfcdc64b-9rglm_563d51ca-738f-4f55-b006-aa87c7d5c104/router/0.log"