Sep 07 21:01:28.051192 ip-10-0-136-145 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 21:01:28.486176 ip-10-0-136-145 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:28.486176 ip-10-0-136-145 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 21:01:28.486176 ip-10-0-136-145 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:28.486176 ip-10-0-136-145 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 21:01:28.486176 ip-10-0-136-145 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 21:01:28.489002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.488903    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 21:01:28.495187 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495165    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.495187 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495183    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.495187 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495187    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.495187 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495191    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.495187 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495194    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495198    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495201    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495205    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495210    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495213    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495216    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495218    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495221    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495223    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495226    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495229    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495231    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495234    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495237    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495240    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495242    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495245    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495248    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.495376 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495250    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495253    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495256    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495258    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495261    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495264    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495266    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495269    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495271    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495274    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495276    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495279    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495282    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495284    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495287    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495290    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495294    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495296    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495299    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495301    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.495831 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495304    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495306    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495309    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495312    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495314    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495317    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495319    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495322    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495325    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495327    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495330    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495332    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495335    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495338    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495341    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495343    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495346    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495348    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495351    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495355    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.496350 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495357    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495360    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495362    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495365    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495368    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495370    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495373    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495376    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495378    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495381    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495384    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495386    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495391    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495394    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495397    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495401    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495404    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495407    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495410    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.496832 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495413    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495416    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495419    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495423    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495427    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495431    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495434    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495437    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495440    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495442    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495445    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495448    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495451    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495455    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495457    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495460    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.495463    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496143    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496150    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496153    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.497324 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496157    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496162    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496166    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496170    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496173    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496176    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496179    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496182    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496185    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496188    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496190    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496193    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496196    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496199    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496202    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496205    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496207    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496211    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496214    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.497809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496218    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496220    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496223    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496225    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496228    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496231    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496233    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496236    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496239    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496241    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496244    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496246    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496249    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496252    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496254    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496256    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496259    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496262    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496264    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496267    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.498308 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496270    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496272    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496275    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496277    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496280    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496282    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496285    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496294    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496297    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496300    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496304    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496307    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496310    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496313    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496316    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496318    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496321    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496324    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496326    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.498782 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496329    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496332    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496335    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496337    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496340    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496342    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496346    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496349    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496351    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496354    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496357    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496360    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496362    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496365    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496367    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496370    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496372    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496375    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496377    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496380    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.499284 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496382    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496385    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496388    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496391    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496393    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496396    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496399    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496401    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496404    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496406    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496410    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496412    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496415    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496417    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496420    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496422    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496424    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496427    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496783    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496787    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.499777 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496790    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496793    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496795    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496798    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496801    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496803    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496806    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496808    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496811    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496813    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496816    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496818    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496821    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496824    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496828    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496831    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496834    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496838    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496858    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496862    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.500292 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496877    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496880    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496883    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496886    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496889    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496892    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496895    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496898    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496900    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496904    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496907    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496910    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496912    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496915    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496918    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496920    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496923    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496925    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496928    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496930    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.500813 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496933    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496935    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496952    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496955    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496960    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496963    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496967    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496972    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496974    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496978    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496980    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496983    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496986    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496988    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496991    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496993    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496996    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.496998    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497001    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497003    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.501335 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497006    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497008    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497011    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497013    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497016    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497018    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497021    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497023    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497026    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497028    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497031    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497033    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497036    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497038    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497042    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497046    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497049    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497052    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497055    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497057    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.501839 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497060    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497064    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497068    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497070    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497073    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497075    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497078    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497080    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497083    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497086    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497088    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497091    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497093    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497096    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497098    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497101    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497103    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497171    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497207    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497214    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 21:01:28.502372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497218    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497222    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497227    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497231    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497235    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497238    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497241    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497244    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497249    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497252    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497255    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497258    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497261    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497264    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497267    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497271    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497274    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497277    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497281    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497284    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497288    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497291    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497294    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 21:01:28.502857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497297    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497300    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497303    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497305    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497308    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497311    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497315    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497318    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497321    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497324    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497327    2583 flags.go:64] FLAG: --enable-server="true"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497333    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497338    2583 flags.go:64] FLAG: --event-burst="100"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497341    2583 flags.go:64] FLAG: --event-qps="50"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497344    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497347    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497350    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497360    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497363    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497366    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497369    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497372    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497375    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497379    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497382    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 21:01:28.503429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497385    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497388    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497391    2583 flags.go:64] FLAG: --feature-gates=""
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497394    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497397    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497400    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497403    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497406    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497409    2583 flags.go:64] FLAG: --help="false"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497412    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497415    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497418    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497421    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497424    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497427    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497430    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497433    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497436    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497440    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497443    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497446    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497449    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497452    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497455    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 21:01:28.504066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497459    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497462    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497465    2583 flags.go:64] FLAG: --lock-file=""
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497468    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497471    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497474    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497479    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497483    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497485    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497488    2583 flags.go:64] FLAG: --logging-format="text"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497491    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497494    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497497    2583 flags.go:64] FLAG: --manifest-url=""
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497500    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497504    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497507    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497511    2583 flags.go:64] FLAG: --max-pods="110"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497513    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497516    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497535    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497539    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497542    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497545    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497548    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497556    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 21:01:28.504673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497559    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497564    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497567    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497570    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497575    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497578    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497581    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497586    2583 flags.go:64] FLAG: --port="10250"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497589    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497592    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024cea58960aef680"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497596    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497599    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497602    2583 flags.go:64] FLAG: --register-node="true"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497604    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497608    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497611    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497614    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497617    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497620    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497623    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497626    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497629    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497632    2583 flags.go:64] FLAG: --runonce="false"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497635    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497638    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 21:01:28.505428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497641    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497644    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497647    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497650    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497653    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497656    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497659    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497662    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497665    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497669    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497672    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497675    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497678    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497683    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497688    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497691    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497703    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497707    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497710    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497713    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497716    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497720    2583 flags.go:64] FLAG: --v="2"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497724    2583 flags.go:64] FLAG: --version="false"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497734    2583 flags.go:64] FLAG: --vmodule=""
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497738    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 21:01:28.506109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.497742    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497862    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497866    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497869    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497872    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497874    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497877    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497880    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497882    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497885    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497887    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497890    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497892    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497895    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497898    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497900    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497904    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497907    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497910    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497912    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.506724 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497915    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497919    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497921    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497924    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497927    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497929    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497932    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497934    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497968    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497972    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497974    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497978    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497982    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497986    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497989    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497992    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497995    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.497998    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498001    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.507237 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498004    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498007    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498010    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498012    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498015    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498017    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498020    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498022    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498025    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498029    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498031    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498034    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498036    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498041    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498046    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498049    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498051    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498054    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498056    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498059    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.507699 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498062    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498064    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498067    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498069    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498072    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498075    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498078    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498080    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498083    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498085    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498088    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498091    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498093    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498095    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498098    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498101    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498103    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498106    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498108    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498111    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.508204 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498113    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498117    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498120    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498122    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498126    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498129    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498133    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498136    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498139    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498142    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498145    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498148    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498150    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498153    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498156    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498159    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498161    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498164    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498168    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498179    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.508697 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.498182    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.498191    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.505735    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.505750    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.505768    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.505774    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505835    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505840    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505844    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505847    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505851    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505854    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505857    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505860    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.509272 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505863    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505865    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505868    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505871    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505873    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505877    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505881    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505884    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505887    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505890    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505892    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505895    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505897    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505900    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505902    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505905    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505908    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505910    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505913    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505916    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.509627 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505918    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505922    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505925    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505928    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505932    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505936    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505951    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505955    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505958    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505960    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505963    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505966    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505969    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505971    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505974    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505977    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505980    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505982    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505985    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.510140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505987    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505990    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505993    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505996    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.505999    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506001    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506004    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506006    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506009    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506013    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506016    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506019    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506022    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506025    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506028    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506032    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506035    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506038    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506041    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.510593 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506043    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506046    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506049    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506052    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506054    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506057    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506060    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506062    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506065    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506067    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506069    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506073    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506075    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506078    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506080    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506083    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506086    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506088    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506091    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506094    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.511070 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506096    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506099    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506101    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506104    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506107    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506109    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506112    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506116    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506118    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506123    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506126    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506129    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506132    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.506137    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506265    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 21:01:28.511590 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506270    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506273    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506276    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506279    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506281    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506284    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506287    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506290    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506293    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506295    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506298    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506301    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506303    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506306    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506308    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506311    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506314    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506316    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506320    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 21:01:28.511971 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506323    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506327    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506330    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506332    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506335    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506338    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506341    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506344    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506347    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506350    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506352    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506355    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506358    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506360    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506363    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506365    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506368    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506370    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506373    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506375    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 21:01:28.512444 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506378    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506380    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506383    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506385    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506387    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506390    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506393    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506395    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506398    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506400    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506403    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506405    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506408    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506411    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506413    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506416    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506418    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506421    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506424    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506427    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 21:01:28.512926 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506429    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506432    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506436    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506439    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506442    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506445    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506448    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506450    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506452    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506455    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506458    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506460    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506463    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506466    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506468    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506471    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506473    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506476    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506478    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 21:01:28.513482 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506481    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506483    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506486    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506488    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506491    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506494    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506498    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506501    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506503    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506506    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506509    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506512    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506515    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506518    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506521    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506531    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506534    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506537    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506539    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 21:01:28.513951 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:28.506542    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.506547    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.506675    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.509075    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.510207    2583 server.go:1019] "Starting client certificate rotation"
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.510333    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.510370    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 21:01:28.514424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.513163    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 21:01:28.514702 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.514463    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 21:01:28.528522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.528504    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 07 21:01:28.531805 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.531785    2583 log.go:25] "Validated CRI v1 image API"
Sep 07 21:01:28.532622 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.532607    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 21:01:28.535319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.535299    2583 fs.go:135] Filesystem UUIDs: map[28cb04ce-ea4e-4cf4-8563-cf677edd77c9:/dev/nvme0n1p3 779d5e3b-a146-4bfb-a458-98472ac87037:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 07 21:01:28.535384 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.535319    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 21:01:28.541306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.541200    2583 manager.go:216] Machine: {Timestamp:2026-09-07 21:01:28.539788162 +0000 UTC m=+0.375914258 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100556 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec216428519674a8f96abb6d053b5541 SystemUUID:ec216428-5196-74a8-f96a-bb6d053b5541 BootID:2c095341-2966-4299-a391-da6f66b8a5b9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6b:d5:e4:71:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6b:d5:e4:71:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:72:bf:78:86:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 21:01:28.541306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.541297    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 21:01:28.541419 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.541370    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 21:01:28.544888 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.544867    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 21:01:28.545050 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.544891    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 21:01:28.545572 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.545558    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 21:01:28.545760 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.545749    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 21:01:28.545798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.545762    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 21:01:28.545798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.545769    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 21:01:28.545798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.545785    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 21:01:28.547689 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.547679    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 21:01:28.551288 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551277    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 21:01:28.551405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551396    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 21:01:28.551435 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551426    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 21:01:28.551468 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551439    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 21:01:28.551468 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551458    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 21:01:28.551530 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551472    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 07 21:01:28.551530 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551484    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 21:01:28.551868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551857    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 21:01:28.551928 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.551875    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 21:01:28.554226 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.554207    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 21:01:28.557255 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.557240    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 21:01:28.557327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.557270    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 21:01:28.558078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558066    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 21:01:28.558122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558084    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 21:01:28.558122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558091    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 21:01:28.558122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558097    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 21:01:28.558122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558105    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 21:01:28.558122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558111    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558126    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558131    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558138    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558169    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558179    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 21:01:28.558267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.558185    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 21:01:28.559055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.559044    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 21:01:28.559055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.559056    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 21:01:28.562824 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.562795    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 21:01:28.562824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.562812    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 21:01:28.562824 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.562800    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 21:01:28.563007 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.562996    2583 server.go:1268] "Started kubelet"
Sep 07 21:01:28.563071 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.563046    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 21:01:28.567161 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.567114    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 21:01:28.567244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.567188    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 21:01:28.567888 ip-10-0-136-145 systemd[1]: Started Kubernetes Kubelet.
Sep 07 21:01:28.568893 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.568872    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 21:01:28.570237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.570216    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 21:01:28.570833 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.570809    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 21:01:28.573998 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.572872    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-145.ec2.internal.18d325a9e1b9be90  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-145.ec2.internal,UID:ip-10-0-136-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-145.ec2.internal,},FirstTimestamp:2026-09-07 21:01:28.56296616 +0000 UTC m=+0.399092256,LastTimestamp:2026-09-07 21:01:28.56296616 +0000 UTC m=+0.399092256,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-145.ec2.internal,}"
Sep 07 21:01:28.576953 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.576921    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 21:01:28.577797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.577606    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 21:01:28.577976 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.577953    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:28.578605 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578587    2583 factory.go:55] Registering systemd factory
Sep 07 21:01:28.578605 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578607    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 07 21:01:28.578762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578610    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 21:01:28.578762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578610    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 21:01:28.578762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578634    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 21:01:28.578762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578703    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 21:01:28.578762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578713    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 21:01:28.578905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578825    2583 factory.go:153] Registering CRI-O factory
Sep 07 21:01:28.578905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578837    2583 factory.go:223] Registration of the crio container factory successfully
Sep 07 21:01:28.578982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578929    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 21:01:28.578982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578964    2583 factory.go:103] Registering Raw factory
Sep 07 21:01:28.578982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.578981    2583 manager.go:1196] Started watching for new ooms in manager
Sep 07 21:01:28.579421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.579409    2583 manager.go:349] Starting recovery of all containers
Sep 07 21:01:28.583587 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.583567    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 21:01:28.583684 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.583666    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 21:01:28.590317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.590298    2583 manager.go:354] Recovery completed
Sep 07 21:01:28.594512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.594499    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.596455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.596436    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.596533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.596468    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.596533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.596478    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.597051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597037    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 21:01:28.597051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597049    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 21:01:28.597162 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597064    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 21:01:28.597162 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597114    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.597914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597896    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.598049 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597924    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.598049 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.597976    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.598166 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.598026    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-145.ec2.internal.18d325a9e3b8bbd5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-145.ec2.internal,UID:ip-10-0-136-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-145.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-145.ec2.internal,},FirstTimestamp:2026-09-07 21:01:28.596454357 +0000 UTC m=+0.432580452,LastTimestamp:2026-09-07 21:01:28.596454357 +0000 UTC m=+0.432580452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-145.ec2.internal,}"
Sep 07 21:01:28.598339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.598323    2583 policy_none.go:49] "None policy: Start"
Sep 07 21:01:28.598339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.598342    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 21:01:28.598496 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.598352    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 21:01:28.599396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.599379    2583 policy_none.go:47] "Start"
Sep 07 21:01:28.600642 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.600625    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcn6h"
Sep 07 21:01:28.609282 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.609186    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-145.ec2.internal.18d325a9e3b90179  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-145.ec2.internal,UID:ip-10-0-136-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-145.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-145.ec2.internal,},FirstTimestamp:2026-09-07 21:01:28.596472185 +0000 UTC m=+0.432598280,LastTimestamp:2026-09-07 21:01:28.596472185 +0000 UTC m=+0.432598280,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-145.ec2.internal,}"
Sep 07 21:01:28.612968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.612929    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcn6h"
Sep 07 21:01:28.626639 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.626613    2583 manager.go:337] "Starting Device Plugin manager"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.626653    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.626664    2583 server.go:87] "Starting device plugin registration server"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.627082    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.627094    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.627267    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.627347    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.627355    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.627999    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 21:01:28.642425 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.628049    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:28.668840 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.668807    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 21:01:28.670068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.670045    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 21:01:28.670189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.670095    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 21:01:28.670189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.670120    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 21:01:28.670189 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.670172    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 21:01:28.672990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.672932    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:28.727542 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.727516    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.728456 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.728441    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.728526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.728472    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.728526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.728486    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.728526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.728510    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.737998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.737928    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.737998 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.737962    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-145.ec2.internal\": node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:28.760554 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.760533    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:28.771248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.770727    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"]
Sep 07 21:01:28.771310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.771290    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.772166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.772149    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.772248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.772181    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.772248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.772191    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.773252 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.773239    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.773391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.773378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.773425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.773407    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.774027 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774009    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.774094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774014    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.774094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774061    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.774094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774080    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.774094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774040    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.774236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.774111    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.775109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.775092    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.775206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.775116    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:28.776053 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.776036    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:28.776126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.776068    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:28.776126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.776082    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:28.780149 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.780133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.780224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.780156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.780224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.780171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0135ba7d47a7fd3cfb345c16777546ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-145.ec2.internal\" (UID: \"0135ba7d47a7fd3cfb345c16777546ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.795454 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.795434    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-145.ec2.internal\" not found" node="ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.799102 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.799084    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-145.ec2.internal\" not found" node="ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.861530 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.861506    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:28.880729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.880834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.880834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0135ba7d47a7fd3cfb345c16777546ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-145.ec2.internal\" (UID: \"0135ba7d47a7fd3cfb345c16777546ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.880834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.880974 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b67fe1fdd99f35926bef5949e67a5c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal\" (UID: \"2b67fe1fdd99f35926bef5949e67a5c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.880974 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:28.880827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0135ba7d47a7fd3cfb345c16777546ed-config\") pod \"kube-apiserver-proxy-ip-10-0-136-145.ec2.internal\" (UID: \"0135ba7d47a7fd3cfb345c16777546ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:28.961882 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:28.961847    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.062529 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.062470    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.097932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.097911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:29.102165 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.101703    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:29.163114 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.163088    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.263650 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.263626    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.364147 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.364087    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.464403 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.464373    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.510005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.509979    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 21:01:29.510403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.510128    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 21:01:29.549055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.549037    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:29.564471 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.564443    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.614762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.614655    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 20:56:29 +0000 UTC" deadline="2028-03-26 23:49:37.460860885 +0000 UTC"
Sep 07 21:01:29.614762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.614721    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13586h48m7.846161981s"
Sep 07 21:01:29.662620 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:29.662584    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b67fe1fdd99f35926bef5949e67a5c3.slice/crio-64dc0571bf1945ef821975d7e507c301cb924e5b4c8adf03747175a0f49f9c23 WatchSource:0}: Error finding container 64dc0571bf1945ef821975d7e507c301cb924e5b4c8adf03747175a0f49f9c23: Status 404 returned error can't find the container with id 64dc0571bf1945ef821975d7e507c301cb924e5b4c8adf03747175a0f49f9c23
Sep 07 21:01:29.664912 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.664888    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.672390 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.672368    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:01:29.674798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.674756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal" event={"ID":"2b67fe1fdd99f35926bef5949e67a5c3","Type":"ContainerStarted","Data":"64dc0571bf1945ef821975d7e507c301cb924e5b4c8adf03747175a0f49f9c23"}
Sep 07 21:01:29.678975 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:29.678940    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0135ba7d47a7fd3cfb345c16777546ed.slice/crio-cd3e387150b4b2173e01ff8436b3c14fff2f474fa262c553d8699e3d1326de92 WatchSource:0}: Error finding container cd3e387150b4b2173e01ff8436b3c14fff2f474fa262c553d8699e3d1326de92: Status 404 returned error can't find the container with id cd3e387150b4b2173e01ff8436b3c14fff2f474fa262c553d8699e3d1326de92
Sep 07 21:01:29.765022 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.764979    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.807506 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.807484    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 21:01:29.808560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.808542    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 21:01:29.808627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.808575    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 21:01:29.808627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.808587    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeHasSufficientPID"
Sep 07 21:01:29.867709 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.867645    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.974303 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:29.974268    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:29.981008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:29.980989    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:30.075178 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.075152    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-145.ec2.internal\" not found"
Sep 07 21:01:30.084608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.084580    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:30.178689 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.178624    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:30.192391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.192369    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 21:01:30.193576 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.193561    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal"
Sep 07 21:01:30.200201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.200185    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 21:01:30.552868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.552781    2583 apiserver.go:52] "Watching apiserver"
Sep 07 21:01:30.559920 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.559889    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 21:01:30.560506 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.560484    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rhzxb","kube-system/konnectivity-agent-bs5sp","kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7","openshift-cluster-node-tuning-operator/tuned-p7c4f","openshift-dns/node-resolver-wjvl5","openshift-multus/network-metrics-daemon-8xdwm","openshift-network-diagnostics/network-check-target-2ddbn","openshift-image-registry/node-ca-8xlvw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal","openshift-multus/multus-additional-cni-plugins-glm7g","openshift-multus/multus-lphrm","openshift-network-operator/iptables-alerter-qwztl","openshift-ovn-kubernetes/ovnkube-node-w65b9"]
Sep 07 21:01:30.563305 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.563279    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.563414 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.563364    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:30.565592 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.565562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.568726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.567780    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.568726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.567792    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.568726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.567911    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 21:01:30.568726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.567930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbgdv\""
Sep 07 21:01:30.568726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.568145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.570174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.570126    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 21:01:30.570388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.570305    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.570617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fjgz\""
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.570749    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.570882    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.571079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.571094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.571497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.571369    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 21:01:30.573043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.573019    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 21:01:30.573413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.573390    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.573413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.573404    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.573636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.573619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.573704 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.573644    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l9hlf\""
Sep 07 21:01:30.575780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.575744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.577146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.576476    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.577146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.576720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-28ww5\""
Sep 07 21:01:30.577146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.576952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.577146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.577093    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 21:01:30.578694 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.578672    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.578933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.578915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n6824\""
Sep 07 21:01:30.579804 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.579150    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.583031 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.580717    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.583203 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.583099    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 21:01:30.583203 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.583183    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.583336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.583303    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.583537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.583518    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bshp8\""
Sep 07 21:01:30.585017 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.584721    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.585017 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.584790    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98c33ad9-dd05-48fd-a8c0-10587dab082a-iptables-alerter-script\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-socket-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-host\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-kubernetes\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-tuned\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-dbus\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysconfig\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-conf\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8f6k\" (UniqueName: \"kubernetes.io/projected/98c33ad9-dd05-48fd-a8c0-10587dab082a-kube-api-access-d8f6k\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlj4\" (UniqueName: \"kubernetes.io/projected/26b804cf-cddc-43ef-9758-86844dd929b2-kube-api-access-pzlj4\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-node-log\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-sys-fs\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587823    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-modprobe-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.588245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-run\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-var-lib-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.587946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-systemd\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-var-lib-kubelet\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-netd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsg2w\" (UniqueName: \"kubernetes.io/projected/ede5e558-6902-4862-aef3-f3006fc71379-kube-api-access-rsg2w\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-host\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26b804cf-cddc-43ef-9758-86844dd929b2-hosts-file\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-etc-selinux\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-config\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovn-node-metrics-cert\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-kubelet\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-log-socket\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-bin\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw76x\" (UniqueName: \"kubernetes.io/projected/46c845f0-43f6-4025-b24a-97a5e44d45a0-kube-api-access-lw76x\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-serviceca\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzgmd\" (UniqueName: \"kubernetes.io/projected/b7700639-a809-449f-b7d6-38b6d2872fc7-kube-api-access-kzgmd\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98c33ad9-dd05-48fd-a8c0-10587dab082a-host-slash\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-systemd-units\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-ovn\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-env-overrides\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-tmp\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgp7\" (UniqueName: \"kubernetes.io/projected/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-kube-api-access-7lgp7\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588665    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b804cf-cddc-43ef-9758-86844dd929b2-tmp-dir\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-systemd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-sys\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-netns\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-script-lib\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.589882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-registration-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-slash\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-etc-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdxt4\" (UniqueName: \"kubernetes.io/projected/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-kube-api-access-kdxt4\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.588976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-device-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.589008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-kubelet-config\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.589031    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-lib-modules\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.590807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.589137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.591727 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.591705    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w7lbz\""
Sep 07 21:01:30.591911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.591894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 21:01:30.592148 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.592125    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 21:01:30.592890 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.592868    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:30.593000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.592912    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 21:01:30.593000 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.592941    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:30.596590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.595929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.597962 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.597939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.598446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.598300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 21:01:30.598446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.598379    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 21:01:30.598590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.598524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 21:01:30.598590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.598526    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pls2p\""
Sep 07 21:01:30.598772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.598756    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 21:01:30.599507 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.599487    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 21:01:30.600235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.600215    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 21:01:30.600749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.600714    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4whtr\""
Sep 07 21:01:30.618258 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.618238    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6gkdv"
Sep 07 21:01:30.626916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.626888    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6gkdv"
Sep 07 21:01:30.678190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.678149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal" event={"ID":"0135ba7d47a7fd3cfb345c16777546ed","Type":"ContainerStarted","Data":"cd3e387150b4b2173e01ff8436b3c14fff2f474fa262c553d8699e3d1326de92"}
Sep 07 21:01:30.680553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.680530    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 21:01:30.690206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-socket-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.690357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-host\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.690357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.690357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-daemon-config\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-kubernetes\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-tuned\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-dbus\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-k8s-cni-cncf-io\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e83580d1-438d-48f3-95c8-342c7b85eeda-agent-certs\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysconfig\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.690564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-conf\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8f6k\" (UniqueName: \"kubernetes.io/projected/98c33ad9-dd05-48fd-a8c0-10587dab082a-kube-api-access-d8f6k\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-hostroot\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-cnibin\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wlh7\" (UniqueName: \"kubernetes.io/projected/5050c00c-189d-4d45-97c3-54a86ae5a3be-kube-api-access-9wlh7\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlj4\" (UniqueName: \"kubernetes.io/projected/26b804cf-cddc-43ef-9758-86844dd929b2-kube-api-access-pzlj4\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-node-log\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-sys-fs\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-modprobe-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-run\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-kubelet\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-var-lib-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-systemd\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-var-lib-kubelet\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-system-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.690974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-netd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2w\" (UniqueName: \"kubernetes.io/projected/ede5e558-6902-4862-aef3-f3006fc71379-kube-api-access-rsg2w\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-host\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26b804cf-cddc-43ef-9758-86844dd929b2-hosts-file\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-socket-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-host\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-socket-dir-parent\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-etc-selinux\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-system-cni-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-config\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovn-node-metrics-cert\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-netns\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-kubelet\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.691992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.691569    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-log-socket\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-bin\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.691638    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:31.191614748 +0000 UTC m=+3.027740838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691664    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-bin\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw76x\" (UniqueName: \"kubernetes.io/projected/46c845f0-43f6-4025-b24a-97a5e44d45a0-kube-api-access-lw76x\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-serviceca\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-node-log\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzgmd\" (UniqueName: \"kubernetes.io/projected/b7700639-a809-449f-b7d6-38b6d2872fc7-kube-api-access-kzgmd\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-sys-fs\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98c33ad9-dd05-48fd-a8c0-10587dab082a-host-slash\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-conf-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e83580d1-438d-48f3-95c8-342c7b85eeda-konnectivity-ca\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691877    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-modprobe-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.692863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-systemd-units\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-ovn\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691968    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-kubernetes\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.691981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-env-overrides\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-binary-copy\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-tmp\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgp7\" (UniqueName: \"kubernetes.io/projected/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-kube-api-access-7lgp7\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b804cf-cddc-43ef-9758-86844dd929b2-tmp-dir\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-systemd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-sys\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-cni-binary-copy\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-netns\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-script-lib\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-registration-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-multus\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-etc-kubernetes\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-slash\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.693740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-etc-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdxt4\" (UniqueName: \"kubernetes.io/projected/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-kube-api-access-kdxt4\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-device-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-kubelet-config\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-bin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6wkf\" (UniqueName: \"kubernetes.io/projected/c0ad9aa7-71f3-488b-a521-94ec9082c051-kube-api-access-t6wkf\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-lib-modules\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-cnibin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-systemd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-run\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-multus-certs\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-kubelet\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692636    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-sys\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692671    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98c33ad9-dd05-48fd-a8c0-10587dab082a-iptables-alerter-script\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.694528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-var-lib-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-log-socket\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692785    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-systemd\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-netns\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-var-lib-kubelet\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.692838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-systemd-units\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-registration-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-run-ovn\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693151    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysconfig\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-host\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-slash\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-host-cni-netd\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693905    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-dbus\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-serviceca\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.693989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-etc-openvswitch\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.695336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-config\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694348    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26b804cf-cddc-43ef-9758-86844dd929b2-tmp-dir\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovnkube-script-lib\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98c33ad9-dd05-48fd-a8c0-10587dab082a-host-slash\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694499    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-etc-selinux\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ede5e558-6902-4862-aef3-f3006fc71379-device-dir\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7d8d215-3588-47cf-bb08-70e0c12ccf40-kubelet-config\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-d\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-sysctl-conf\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.694741    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.694792    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:31.194776344 +0000 UTC m=+3.030902446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.694799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c845f0-43f6-4025-b24a-97a5e44d45a0-lib-modules\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.695115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-env-overrides\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.695506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26b804cf-cddc-43ef-9758-86844dd929b2-hosts-file\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.696315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.695596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98c33ad9-dd05-48fd-a8c0-10587dab082a-iptables-alerter-script\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.699534 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.699512    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-ovn-node-metrics-cert\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.699534 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.699526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-etc-tuned\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.699931 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.699904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46c845f0-43f6-4025-b24a-97a5e44d45a0-tmp\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.708738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.708652    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlj4\" (UniqueName: \"kubernetes.io/projected/26b804cf-cddc-43ef-9758-86844dd929b2-kube-api-access-pzlj4\") pod \"node-resolver-wjvl5\" (UID: \"26b804cf-cddc-43ef-9758-86844dd929b2\") " pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.709798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.709753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8f6k\" (UniqueName: \"kubernetes.io/projected/98c33ad9-dd05-48fd-a8c0-10587dab082a-kube-api-access-d8f6k\") pod \"iptables-alerter-qwztl\" (UID: \"98c33ad9-dd05-48fd-a8c0-10587dab082a\") " pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.709893 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.709774    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsg2w\" (UniqueName: \"kubernetes.io/projected/ede5e558-6902-4862-aef3-f3006fc71379-kube-api-access-rsg2w\") pod \"aws-ebs-csi-driver-node-pg2k7\" (UID: \"ede5e558-6902-4862-aef3-f3006fc71379\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.709893 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.709819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgp7\" (UniqueName: \"kubernetes.io/projected/9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6-kube-api-access-7lgp7\") pod \"node-ca-8xlvw\" (UID: \"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6\") " pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.711231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.711209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdxt4\" (UniqueName: \"kubernetes.io/projected/18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4-kube-api-access-kdxt4\") pod \"ovnkube-node-w65b9\" (UID: \"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.711644 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.711611    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw76x\" (UniqueName: \"kubernetes.io/projected/46c845f0-43f6-4025-b24a-97a5e44d45a0-kube-api-access-lw76x\") pod \"tuned-p7c4f\" (UID: \"46c845f0-43f6-4025-b24a-97a5e44d45a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.713319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.713294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzgmd\" (UniqueName: \"kubernetes.io/projected/b7700639-a809-449f-b7d6-38b6d2872fc7-kube-api-access-kzgmd\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:30.725839 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.725806    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 21:01:30.793306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-cni-binary-copy\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-multus\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-etc-kubernetes\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-bin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6wkf\" (UniqueName: \"kubernetes.io/projected/c0ad9aa7-71f3-488b-a521-94ec9082c051-kube-api-access-t6wkf\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-cnibin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-multus-certs\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-daemon-config\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-k8s-cni-cncf-io\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e83580d1-438d-48f3-95c8-342c7b85eeda-agent-certs\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-hostroot\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-cnibin\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wlh7\" (UniqueName: \"kubernetes.io/projected/5050c00c-189d-4d45-97c3-54a86ae5a3be-kube-api-access-9wlh7\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.793712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-kubelet\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-system-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-socket-dir-parent\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-system-cni-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-netns\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.793932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-conf-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.793977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e83580d1-438d-48f3-95c8-342c7b85eeda-konnectivity-ca\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-binary-copy\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794099    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-hostroot\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-socket-dir-parent\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-cnibin\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.794610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-kubelet\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-system-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-cni-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-cni-binary-copy\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-binary-copy\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.794873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794809    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-etc-kubernetes\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-bin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794862    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-conf-dir\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.794978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.794908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-system-cni-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.795160 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-cnibin\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.795247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-multus-certs\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.795247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-netns\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.795388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-run-k8s-cni-cncf-io\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.795388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e83580d1-438d-48f3-95c8-342c7b85eeda-konnectivity-ca\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.795497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.795497 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c0ad9aa7-71f3-488b-a521-94ec9082c051-host-var-lib-cni-multus\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.795828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5050c00c-189d-4d45-97c3-54a86ae5a3be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.795828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5050c00c-189d-4d45-97c3-54a86ae5a3be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.795828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.795829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c0ad9aa7-71f3-488b-a521-94ec9082c051-multus-daemon-config\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.798062 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.798042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e83580d1-438d-48f3-95c8-342c7b85eeda-agent-certs\") pod \"konnectivity-agent-bs5sp\" (UID: \"e83580d1-438d-48f3-95c8-342c7b85eeda\") " pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.802553 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.802532    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:30.802553 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.802555    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:30.802728 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.802569    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:30.802728 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:30.802665    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:31.302623055 +0000 UTC m=+3.138749158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:30.805207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.805144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wlh7\" (UniqueName: \"kubernetes.io/projected/5050c00c-189d-4d45-97c3-54a86ae5a3be-kube-api-access-9wlh7\") pod \"multus-additional-cni-plugins-glm7g\" (UID: \"5050c00c-189d-4d45-97c3-54a86ae5a3be\") " pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.805207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.805195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6wkf\" (UniqueName: \"kubernetes.io/projected/c0ad9aa7-71f3-488b-a521-94ec9082c051-kube-api-access-t6wkf\") pod \"multus-lphrm\" (UID: \"c0ad9aa7-71f3-488b-a521-94ec9082c051\") " pod="openshift-multus/multus-lphrm"
Sep 07 21:01:30.881415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.881372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwztl"
Sep 07 21:01:30.891132 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.891095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:30.903154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.903120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7"
Sep 07 21:01:30.910055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.910034    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p7c4f"
Sep 07 21:01:30.918832 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.918808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjvl5"
Sep 07 21:01:30.926712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.926680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8xlvw"
Sep 07 21:01:30.935577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.935555    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:30.945581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.945555    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-glm7g"
Sep 07 21:01:30.951452 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:30.951426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lphrm"
Sep 07 21:01:31.197640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.197565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:31.197640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.197607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:31.197843 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.197767    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:31.197843 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.197770    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:31.197843 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.197824    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:32.197808735 +0000 UTC m=+4.033934820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:31.198027 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.197845    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:32.1978342 +0000 UTC m=+4.033960286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:31.399090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.399049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:31.399279 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.399225    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:31.399279 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.399246    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:31.399279 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.399260    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:31.399422 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.399315    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:32.399298521 +0000 UTC m=+4.235424615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:31.631198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.631082    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:56:30 +0000 UTC" deadline="2028-06-08 15:04:19.425427792 +0000 UTC"
Sep 07 21:01:31.631198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.631148    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15354h2m47.794284753s"
Sep 07 21:01:31.671421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:31.671384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:31.671573 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:31.671541    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:31.897553 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.897527    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dd2e15_5dd3_4cd3_9d3e_1ae4fe88adb4.slice/crio-eff78d24a27b71e92046930d1fed82a0df1652ff76a6ccd7f1c7fba1beb32992 WatchSource:0}: Error finding container eff78d24a27b71e92046930d1fed82a0df1652ff76a6ccd7f1c7fba1beb32992: Status 404 returned error can't find the container with id eff78d24a27b71e92046930d1fed82a0df1652ff76a6ccd7f1c7fba1beb32992
Sep 07 21:01:31.898709 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.898671    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5050c00c_189d_4d45_97c3_54a86ae5a3be.slice/crio-21124bc333ac0b895069bfa620de1cfc0e66f62cf32821060e7eb1f726c02e42 WatchSource:0}: Error finding container 21124bc333ac0b895069bfa620de1cfc0e66f62cf32821060e7eb1f726c02e42: Status 404 returned error can't find the container with id 21124bc333ac0b895069bfa620de1cfc0e66f62cf32821060e7eb1f726c02e42
Sep 07 21:01:31.899457 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.899350    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83580d1_438d_48f3_95c8_342c7b85eeda.slice/crio-acb11b5689413661bc12434f2b9ce4a1a3cd2925fcce273c82821a8a09cfb26c WatchSource:0}: Error finding container acb11b5689413661bc12434f2b9ce4a1a3cd2925fcce273c82821a8a09cfb26c: Status 404 returned error can't find the container with id acb11b5689413661bc12434f2b9ce4a1a3cd2925fcce273c82821a8a09cfb26c
Sep 07 21:01:31.900565 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.900483    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b804cf_cddc_43ef_9758_86844dd929b2.slice/crio-468165407adde6722e1ea44a4cf0b5cb9755d77646d2c005d64812edea1c0f94 WatchSource:0}: Error finding container 468165407adde6722e1ea44a4cf0b5cb9755d77646d2c005d64812edea1c0f94: Status 404 returned error can't find the container with id 468165407adde6722e1ea44a4cf0b5cb9755d77646d2c005d64812edea1c0f94
Sep 07 21:01:31.901793 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.901702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c845f0_43f6_4025_b24a_97a5e44d45a0.slice/crio-250b007f6ca9f2131f8bcb701b8831ce96d1dfcfeb8b3c6be8aec89c0e4e860b WatchSource:0}: Error finding container 250b007f6ca9f2131f8bcb701b8831ce96d1dfcfeb8b3c6be8aec89c0e4e860b: Status 404 returned error can't find the container with id 250b007f6ca9f2131f8bcb701b8831ce96d1dfcfeb8b3c6be8aec89c0e4e860b
Sep 07 21:01:31.902757 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.902729    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede5e558_6902_4862_aef3_f3006fc71379.slice/crio-51e3a652355cacec7e2c28dcb129fa0a2aa8cc59f4d2244a5b060353ac620334 WatchSource:0}: Error finding container 51e3a652355cacec7e2c28dcb129fa0a2aa8cc59f4d2244a5b060353ac620334: Status 404 returned error can't find the container with id 51e3a652355cacec7e2c28dcb129fa0a2aa8cc59f4d2244a5b060353ac620334
Sep 07 21:01:31.905152 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.904832    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c33ad9_dd05_48fd_a8c0_10587dab082a.slice/crio-56e748ee1eb13878db0c568a8b7e45be57dc538a1367501aa78b8f670b205a00 WatchSource:0}: Error finding container 56e748ee1eb13878db0c568a8b7e45be57dc538a1367501aa78b8f670b205a00: Status 404 returned error can't find the container with id 56e748ee1eb13878db0c568a8b7e45be57dc538a1367501aa78b8f670b205a00
Sep 07 21:01:31.906129 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.906104    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ad9aa7_71f3_488b_a521_94ec9082c051.slice/crio-45aee54367e37ec318b32043f30d1bab7d98209106316dfad353f2d7fe60a753 WatchSource:0}: Error finding container 45aee54367e37ec318b32043f30d1bab7d98209106316dfad353f2d7fe60a753: Status 404 returned error can't find the container with id 45aee54367e37ec318b32043f30d1bab7d98209106316dfad353f2d7fe60a753
Sep 07 21:01:31.907619 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:01:31.907584    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8b8d20_ae1f_4ad6_9ee9_2f73d351e0a6.slice/crio-096a8427a6ebaf2f79a49c2752fc94bd990bd864ce1bf098949a2294dc8ad712 WatchSource:0}: Error finding container 096a8427a6ebaf2f79a49c2752fc94bd990bd864ce1bf098949a2294dc8ad712: Status 404 returned error can't find the container with id 096a8427a6ebaf2f79a49c2752fc94bd990bd864ce1bf098949a2294dc8ad712
Sep 07 21:01:32.204898 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.204870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:32.205000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.204915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:32.205083 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.205069    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:32.205128 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.205119    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:34.205105861 +0000 UTC m=+6.041231946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:32.205195 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.205071    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:32.205234 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.205213    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:34.205199408 +0000 UTC m=+6.041325497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:32.407132 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.407093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:32.407318 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.407273    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:32.407318 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.407296    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:32.407318 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.407306    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:32.407437 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.407361    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:34.407346591 +0000 UTC m=+6.243472693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:32.631899 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.631768    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:56:30 +0000 UTC" deadline="2028-05-21 03:52:51.043549624 +0000 UTC"
Sep 07 21:01:32.631899 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.631804    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14910h51m18.411750351s"
Sep 07 21:01:32.673700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.672611    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:32.673700 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.672761    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:32.673700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.673582    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:32.673700 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:32.673685    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:32.693412 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.693377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjvl5" event={"ID":"26b804cf-cddc-43ef-9758-86844dd929b2","Type":"ContainerStarted","Data":"468165407adde6722e1ea44a4cf0b5cb9755d77646d2c005d64812edea1c0f94"}
Sep 07 21:01:32.698644 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.698614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bs5sp" event={"ID":"e83580d1-438d-48f3-95c8-342c7b85eeda","Type":"ContainerStarted","Data":"acb11b5689413661bc12434f2b9ce4a1a3cd2925fcce273c82821a8a09cfb26c"}
Sep 07 21:01:32.719371 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.719327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"eff78d24a27b71e92046930d1fed82a0df1652ff76a6ccd7f1c7fba1beb32992"}
Sep 07 21:01:32.727658 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.726552    2583 generic.go:356] "Generic (PLEG): container finished" podID="2b67fe1fdd99f35926bef5949e67a5c3" containerID="6650a9702ae014183a970dd5ec072d6c36e19c014f082ff2902dcb20b8f0ec26" exitCode=0
Sep 07 21:01:32.727658 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.726640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal" event={"ID":"2b67fe1fdd99f35926bef5949e67a5c3","Type":"ContainerDied","Data":"6650a9702ae014183a970dd5ec072d6c36e19c014f082ff2902dcb20b8f0ec26"}
Sep 07 21:01:32.753782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.753627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xlvw" event={"ID":"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6","Type":"ContainerStarted","Data":"096a8427a6ebaf2f79a49c2752fc94bd990bd864ce1bf098949a2294dc8ad712"}
Sep 07 21:01:32.758275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.758246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lphrm" event={"ID":"c0ad9aa7-71f3-488b-a521-94ec9082c051","Type":"ContainerStarted","Data":"45aee54367e37ec318b32043f30d1bab7d98209106316dfad353f2d7fe60a753"}
Sep 07 21:01:32.766969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.766937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p7c4f" event={"ID":"46c845f0-43f6-4025-b24a-97a5e44d45a0","Type":"ContainerStarted","Data":"250b007f6ca9f2131f8bcb701b8831ce96d1dfcfeb8b3c6be8aec89c0e4e860b"}
Sep 07 21:01:32.771268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.771242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerStarted","Data":"21124bc333ac0b895069bfa620de1cfc0e66f62cf32821060e7eb1f726c02e42"}
Sep 07 21:01:32.785783 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.785753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal" event={"ID":"0135ba7d47a7fd3cfb345c16777546ed","Type":"ContainerStarted","Data":"481e74b1d57207f4caeb890d2fe0c3fd1b2a008d431d8a689ff8040a40060f79"}
Sep 07 21:01:32.799734 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.799703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwztl" event={"ID":"98c33ad9-dd05-48fd-a8c0-10587dab082a","Type":"ContainerStarted","Data":"56e748ee1eb13878db0c568a8b7e45be57dc538a1367501aa78b8f670b205a00"}
Sep 07 21:01:32.802421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.802238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7" event={"ID":"ede5e558-6902-4862-aef3-f3006fc71379","Type":"ContainerStarted","Data":"51e3a652355cacec7e2c28dcb129fa0a2aa8cc59f4d2244a5b060353ac620334"}
Sep 07 21:01:32.802786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:32.802736    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-145.ec2.internal" podStartSLOduration=2.8027191609999997 podStartE2EDuration="2.802719161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:32.802407589 +0000 UTC m=+4.638533699" watchObservedRunningTime="2026-09-07 21:01:32.802719161 +0000 UTC m=+4.638845271"
Sep 07 21:01:33.671775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:33.670933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:33.671775 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:33.671104    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:33.850754 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:33.850618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal" event={"ID":"2b67fe1fdd99f35926bef5949e67a5c3","Type":"ContainerStarted","Data":"6c12faa2ebf6a1c070ffa48ce1481966439bee4cf6d9dac58aa6e9c05f37d52e"}
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:34.227385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:34.227456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.227601    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.227670    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:38.227650605 +0000 UTC m=+10.063776695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.228092    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:34.228278 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.228143    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:38.228126959 +0000 UTC m=+10.064253047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:34.430503 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:34.429794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:34.430503 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.429999    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:34.430503 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.430023    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:34.430503 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.430037    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:34.430503 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.430106    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:38.430087515 +0000 UTC m=+10.266213604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:34.672782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:34.672141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:34.672782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:34.672149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:34.672782 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.672292    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:34.672782 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:34.672447    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:35.670656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:35.670622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:35.670822 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:35.670765    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:36.671096 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:36.671063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:36.671486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:36.671098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:36.671486 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:36.671213    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:36.671486 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:36.671336    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:37.671068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:37.670991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:37.671233 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:37.671129    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:38.263113 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:38.263077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:38.263297 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:38.263135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:38.263297 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.263240    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:38.263297 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.263256    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:38.263297 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.263296    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.263272684 +0000 UTC m=+18.099398786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:38.263515 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.263326    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.263308847 +0000 UTC m=+18.099434933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:38.463958 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:38.463915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:38.464120 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.464082    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:38.464120 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.464101    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:38.464120 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.464113    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:38.464296 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.464178    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:01:46.464159399 +0000 UTC m=+18.300285499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:38.671985 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:38.671822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:38.671985 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.671928    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:38.672438 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:38.672021    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:38.672438 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:38.672092    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:39.671466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:39.671028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:39.671466 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:39.671168    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:40.671477 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:40.671186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:40.671878 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:40.671260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:40.671878 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:40.671552    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:40.671878 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:40.671612    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:41.671093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:41.671056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:41.671289 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:41.671187    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:42.671028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:42.670997    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:42.671028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:42.671018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:42.671505 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:42.671133    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:42.671505 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:42.671219    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:43.670782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:43.670707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:43.670974 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:43.670894    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:44.670668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:44.670636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:44.670668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:44.670656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:44.671186 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:44.670742    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:44.671186 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:44.670822    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:45.671366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:45.671332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:45.671838 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:45.671477    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:46.325271 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:46.325224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:46.325461 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:46.325288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:46.325461 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.325404    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.325563 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.325473    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:02.325456521 +0000 UTC m=+34.161582604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:01:46.325563 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.325413    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.325673 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.325567    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:02.325544022 +0000 UTC m=+34.161670109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:01:46.526425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:46.526379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:46.526608 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.526566    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:01:46.526608 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.526594    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:01:46.526608 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.526607    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:46.526767 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.526671    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:02.526653927 +0000 UTC m=+34.362780016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:01:46.670693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:46.670601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:46.670843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:46.670601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:46.670843 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.670748    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:46.670843 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:46.670803    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:47.670460 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:47.670426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:47.670923 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:47.670591    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:48.671353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:48.671323    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:48.671759 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:48.671434    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:48.671759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:48.671481    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:48.671759 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:48.671573    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:49.670844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:49.670816    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:49.670994 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:49.670910    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:50.670791 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.670608    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:50.671672 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.670612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:50.671672 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:50.670878    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:50.671672 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:50.671010    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:50.886734 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.886618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7" event={"ID":"ede5e558-6902-4862-aef3-f3006fc71379","Type":"ContainerStarted","Data":"d01474054d823db65795889cb0c0b0e0acf51de3a84966c2ee60fe6c1cb87a9f"}
Sep 07 21:01:50.888372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.888339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjvl5" event={"ID":"26b804cf-cddc-43ef-9758-86844dd929b2","Type":"ContainerStarted","Data":"e7c84172aaf434209bf5ab9333b7553509cd71900317b82356ab6405ae609871"}
Sep 07 21:01:50.889976 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.889931    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bs5sp" event={"ID":"e83580d1-438d-48f3-95c8-342c7b85eeda","Type":"ContainerStarted","Data":"b892e62bdc97a247f567e0ce234b4ec839d3f754fd99282f4dc8c5d595f6fdfe"}
Sep 07 21:01:50.893058 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893038    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:01:50.893451 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893421    2583 generic.go:356] "Generic (PLEG): container finished" podID="18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4" containerID="6cefdd4a1329c3274cc53d5028a704d4206a4e73b54c815a3e361034e7e2823f" exitCode=1
Sep 07 21:01:50.893528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893484    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"068f91d43a2ab0df77f0401e272b82458a40e0386e33913980bce61aa3521f4e"}
Sep 07 21:01:50.893585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"8062c48e8f140a3cf06c9f26dfcfe77d2a6bbe0e6a47926f76e9d1609c910c4e"}
Sep 07 21:01:50.893635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893606    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"b44a2250da1420351f95ce5915f655f040e580ecef7c86856a70c0bbaa3888e3"}
Sep 07 21:01:50.893675 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"34e56f9ddc15e45e508cde29cd1d3640db593721fc4be93b137c1e7c285aeaf0"}
Sep 07 21:01:50.893715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerDied","Data":"6cefdd4a1329c3274cc53d5028a704d4206a4e73b54c815a3e361034e7e2823f"}
Sep 07 21:01:50.893765 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.893718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"6644e5d15c11f04f849b7c8ec287facc773aba3dc3294b6b03b4a9be6f5da861"}
Sep 07 21:01:50.895073 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.895050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8xlvw" event={"ID":"9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6","Type":"ContainerStarted","Data":"8a1e55f77d9fa7ac98a9a8e000a7af40e98ffed975a61a08cca71b9e2f565ad9"}
Sep 07 21:01:50.896665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.896643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lphrm" event={"ID":"c0ad9aa7-71f3-488b-a521-94ec9082c051","Type":"ContainerStarted","Data":"f86163694baad404f2295bcde82c45b97df3310dafd4b9bd7860a084864ed976"}
Sep 07 21:01:50.898510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.898487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p7c4f" event={"ID":"46c845f0-43f6-4025-b24a-97a5e44d45a0","Type":"ContainerStarted","Data":"730990c3f3b51a28bc5e8b5f4cb1cc8c1b3c7e1f66d5dfd727e0955e6981ab96"}
Sep 07 21:01:50.900175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.900155    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="d6f2a91416135906ca9decead9e20deab78c50d5fc123892a1f38068e6dffe1b" exitCode=0
Sep 07 21:01:50.900267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.900189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"d6f2a91416135906ca9decead9e20deab78c50d5fc123892a1f38068e6dffe1b"}
Sep 07 21:01:50.903989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.903924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-145.ec2.internal" podStartSLOduration=20.903908324 podStartE2EDuration="20.903908324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:33.868035007 +0000 UTC m=+5.704161118" watchObservedRunningTime="2026-09-07 21:01:50.903908324 +0000 UTC m=+22.740034431"
Sep 07 21:01:50.904610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.904574    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wjvl5" podStartSLOduration=3.912583938 podStartE2EDuration="21.904566413s" totalImagesPullingTime="17.991982475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:50.903794326 +0000 UTC m=+22.739920431" watchObservedRunningTime="2026-09-07 21:01:50.904566413 +0000 UTC m=+22.740692518"
Sep 07 21:01:50.919853 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.919816    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p7c4f" podStartSLOduration=3.928572539 podStartE2EDuration="21.919805108s" totalImagesPullingTime="17.991232569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:50.919387211 +0000 UTC m=+22.755513320" watchObservedRunningTime="2026-09-07 21:01:50.919805108 +0000 UTC m=+22.755931215"
Sep 07 21:01:50.931742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.931709    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8xlvw" podStartSLOduration=3.948689506 podStartE2EDuration="21.931694365s" totalImagesPullingTime="17.983004859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:50.931450873 +0000 UTC m=+22.767576979" watchObservedRunningTime="2026-09-07 21:01:50.931694365 +0000 UTC m=+22.767820474"
Sep 07 21:01:50.947144 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.947105    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bs5sp" podStartSLOduration=4.033141238 podStartE2EDuration="21.947094712s" totalImagesPullingTime="17.913953474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:50.946493124 +0000 UTC m=+22.782619232" watchObservedRunningTime="2026-09-07 21:01:50.947094712 +0000 UTC m=+22.783220817"
Sep 07 21:01:50.975727 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:50.975687    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lphrm" podStartSLOduration=3.729113049 podStartE2EDuration="21.975673635s" totalImagesPullingTime="18.246560586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:50.97524936 +0000 UTC m=+22.811375464" watchObservedRunningTime="2026-09-07 21:01:50.975673635 +0000 UTC m=+22.811799741"
Sep 07 21:01:51.358328 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.358184    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 21:01:51.640366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.640208    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T21:01:51.35832423Z","UUID":"af55a9c2-d0ff-41aa-8c5f-75accdfe24f7","Handler":null,"Name":"","Endpoint":""}
Sep 07 21:01:51.655337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.655296    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 21:01:51.655499 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.655355    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 21:01:51.671175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.671153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:51.671595 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:51.671263    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:51.905348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.905051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwztl" event={"ID":"98c33ad9-dd05-48fd-a8c0-10587dab082a","Type":"ContainerStarted","Data":"ca8a3a5826ec264aefd108abce82639d34fd69cb5c8cef44cc7ff9c4a21c4304"}
Sep 07 21:01:51.907442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.907377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7" event={"ID":"ede5e558-6902-4862-aef3-f3006fc71379","Type":"ContainerStarted","Data":"d25db833a8e1dc6733864a720bd927c83fbf7803c119d13da36e9057c46da335"}
Sep 07 21:01:51.920780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:51.920645    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qwztl" podStartSLOduration=4.934120196 podStartE2EDuration="22.920627863s" totalImagesPullingTime="17.986507667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:51.919827839 +0000 UTC m=+23.755953946" watchObservedRunningTime="2026-09-07 21:01:51.920627863 +0000 UTC m=+23.756753969"
Sep 07 21:01:52.514746 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.514719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:52.671338 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.671309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:52.671692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.671344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:52.671692 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:52.671443    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:52.671692 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:52.671614    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:52.913401 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.913376    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:01:52.913892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.913863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"fb622c05b6169635826505d54d5f3dd7718b9d33a3aa84e76025614079363229"}
Sep 07 21:01:52.916218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.916193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7" event={"ID":"ede5e558-6902-4862-aef3-f3006fc71379","Type":"ContainerStarted","Data":"9bfffeb10dae1164c59f3fb2da05fefdc5fee0e8628f1b7119207db459bf653d"}
Sep 07 21:01:52.934450 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:52.934411    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pg2k7" podStartSLOduration=3.9176061840000003 podStartE2EDuration="23.934398915s" totalImagesPullingTime="20.016792731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:52.933932159 +0000 UTC m=+24.770058263" watchObservedRunningTime="2026-09-07 21:01:52.934398915 +0000 UTC m=+24.770525017"
Sep 07 21:01:53.671188 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:53.671153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:53.671416 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:53.671303    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:54.673721 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:54.673696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:54.674085 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:54.673732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:54.674085 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:54.673799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:54.674085 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:54.673963    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:54.900125 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:54.900089    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:54.900757 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:54.900731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:54.921632 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:54.921573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bs5sp"
Sep 07 21:01:55.671119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:55.671076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:55.671293 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:55.671209    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:56.670683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.670523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:56.671256 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.670523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:56.671256 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:56.670764    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:56.671256 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:56.670838    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:56.929549 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.929473    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:01:56.929895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.929870    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"86eef98fdeb81104c5166fe779971cbac96574e69df8e1797603b90404dde567"}
Sep 07 21:01:56.930200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.930182    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:56.930341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.930318    2583 scope.go:117] "RemoveContainer" containerID="6cefdd4a1329c3274cc53d5028a704d4206a4e73b54c815a3e361034e7e2823f"
Sep 07 21:01:56.932115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.932086    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="e7c17b22b8a4c0e757fd9320ae8942962a0226c80d345834aaf26cd2d8a00c25" exitCode=0
Sep 07 21:01:56.932189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.932120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"e7c17b22b8a4c0e757fd9320ae8942962a0226c80d345834aaf26cd2d8a00c25"}
Sep 07 21:01:56.947299 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:56.947262    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:57.671433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.671392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:57.671964 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:57.671552    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:57.913763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.913732    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xdwm"]
Sep 07 21:01:57.916614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.916574    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhzxb"]
Sep 07 21:01:57.916770 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.916705    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:57.916833 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:57.916812    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:57.917344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.917324    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ddbn"]
Sep 07 21:01:57.917449 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.917414    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:57.917509 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:57.917495    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:57.937370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.937272    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="c9ab7236e25d01971b6b64ba78e8cf7ef2f36bf4a03d6b5c1cc6152428e4c49e" exitCode=0
Sep 07 21:01:57.937583 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.937564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"c9ab7236e25d01971b6b64ba78e8cf7ef2f36bf4a03d6b5c1cc6152428e4c49e"}
Sep 07 21:01:57.944362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.944342    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:01:57.944818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.944791    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" event={"ID":"18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4","Type":"ContainerStarted","Data":"fa4b03e659d9a6e12f8a6aac1c1d10ab7e1d3d69add02c106877f309de8ccd78"}
Sep 07 21:01:57.944818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.944807    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:57.944925 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:57.944907    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:01:57.945002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.944985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:57.945074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.945061    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:57.961042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.961021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:01:57.990836 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:57.990786    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9" podStartSLOduration=10.98209173 podStartE2EDuration="28.990770836s" totalImagesPullingTime="18.008679106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:01:57.990252711 +0000 UTC m=+29.826378816" watchObservedRunningTime="2026-09-07 21:01:57.990770836 +0000 UTC m=+29.826896942"
Sep 07 21:01:58.949758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:58.949720    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="f1a4de5b6e490a5097bb3af36a00cf599d088d032333af3fbea198924ff3dc89" exitCode=0
Sep 07 21:01:58.950160 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:58.949812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"f1a4de5b6e490a5097bb3af36a00cf599d088d032333af3fbea198924ff3dc89"}
Sep 07 21:01:59.671158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:59.671126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:01:59.671350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:59.671234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:01:59.671350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:01:59.671248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:01:59.671350 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:59.671240    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:01:59.671521 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:59.671360    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:01:59.671521 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:01:59.671462    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:02:01.671322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:01.671280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:01.671322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:01.671308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:02:01.671805 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:01.671298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:01.671805 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:01.671416    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhzxb" podUID="b7d8d215-3588-47cf-bb08-70e0c12ccf40"
Sep 07 21:02:01.671805 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:01.671482    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ddbn" podUID="ec736dc7-0375-4bd6-bd03-bc58ceaff2e7"
Sep 07 21:02:01.671805 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:01.671587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xdwm" podUID="b7700639-a809-449f-b7d6-38b6d2872fc7"
Sep 07 21:02:02.348453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:02.348412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:02:02.348637 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:02.348482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:02.348637 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.348562    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:02.348637 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.348607    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:02.348637 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.348627    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.348613726 +0000 UTC m=+66.184739827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 21:02:02.348847 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.348667    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret podName:b7d8d215-3588-47cf-bb08-70e0c12ccf40 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.348653929 +0000 UTC m=+66.184780012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret") pod "global-pull-secret-syncer-rhzxb" (UID: "b7d8d215-3588-47cf-bb08-70e0c12ccf40") : object "kube-system"/"original-pull-secret" not registered
Sep 07 21:02:02.550692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:02.550654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:02.550850 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.550805    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 21:02:02.550850 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.550824    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 21:02:02.550850 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.550833    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cdfzn for pod openshift-network-diagnostics/network-check-target-2ddbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:02.551015 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:02.550896    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn podName:ec736dc7-0375-4bd6-bd03-bc58ceaff2e7 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.550876523 +0000 UTC m=+66.387002607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdfzn" (UniqueName: "kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn") pod "network-check-target-2ddbn" (UID: "ec736dc7-0375-4bd6-bd03-bc58ceaff2e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 21:02:02.962790 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:02.962757    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-145.ec2.internal" event="NodeReady"
Sep 07 21:02:02.963278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:02.962893    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 21:02:03.002783 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.002747    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:02:03.028274 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.028129    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cf2p8"]
Sep 07 21:02:03.028449 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.028326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.030841 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.030817    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 21:02:03.031112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.030892    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 21:02:03.031112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.030929    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 21:02:03.031112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.030928    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqps2\""
Sep 07 21:02:03.037512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.037486    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 21:02:03.042022 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.042002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-swbg5"]
Sep 07 21:02:03.042134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.042124    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.044420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.044398    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 21:02:03.044537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.044463    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 21:02:03.044657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.044637    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7njqf\""
Sep 07 21:02:03.058154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.058131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:02:03.058154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.058162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-swbg5"]
Sep 07 21:02:03.058317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.058179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf2p8"]
Sep 07 21:02:03.058317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.058242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.061228 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.061208    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrq2d\""
Sep 07 21:02:03.061703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.061686    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 21:02:03.061793 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.061758    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 21:02:03.061793 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.061781    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 21:02:03.154682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd1cd7-18be-403b-97e4-0ed075627055-tmp-dir\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.154864 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.154864 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd1cd7-18be-403b-97e4-0ed075627055-config-volume\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.154864 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kvp\" (UniqueName: \"kubernetes.io/projected/5dcd1cd7-18be-403b-97e4-0ed075627055-kube-api-access-k9kvp\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.155064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr58w\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-cert\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.155064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.154983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155086    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.155275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155119    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.155275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42jm\" (UniqueName: \"kubernetes.io/projected/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-kube-api-access-t42jm\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.155275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.155178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.181150 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.181113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:03.255763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd1cd7-18be-403b-97e4-0ed075627055-config-volume\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.255763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kvp\" (UniqueName: \"kubernetes.io/projected/5dcd1cd7-18be-403b-97e4-0ed075627055-kube-api-access-k9kvp\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.255763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr58w\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-cert\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.255976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42jm\" (UniqueName: \"kubernetes.io/projected/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-kube-api-access-t42jm\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd1cd7-18be-403b-97e4-0ed075627055-tmp-dir\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.256088    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.256188    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:03.756167248 +0000 UTC m=+35.592293331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.256262    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.256275    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.256316    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:03.756303422 +0000 UTC m=+35.592429506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256379    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dcd1cd7-18be-403b-97e4-0ed075627055-config-volume\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.256546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.256897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.256815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcd1cd7-18be-403b-97e4-0ed075627055-tmp-dir\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.257398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.257342    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.260495 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.260473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.260598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.260492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.260598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.260526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-cert\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.264731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.264710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.264844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.264824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kvp\" (UniqueName: \"kubernetes.io/projected/5dcd1cd7-18be-403b-97e4-0ed075627055-kube-api-access-k9kvp\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.264925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.264908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42jm\" (UniqueName: \"kubernetes.io/projected/ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a-kube-api-access-t42jm\") pod \"ingress-canary-swbg5\" (UID: \"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a\") " pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.265406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.265389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr58w\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.367369 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.367331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-swbg5"
Sep 07 21:02:03.671301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.671132    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:03.671485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.671138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:02:03.671485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.671149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:03.674515 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 21:02:03.674647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674576    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 21:02:03.674647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 21:02:03.674647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674577    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 21:02:03.674806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674581    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8wd\""
Sep 07 21:02:03.674806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.674576    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xs9mt\""
Sep 07 21:02:03.718381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.718354    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-swbg5"]
Sep 07 21:02:03.722864 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:03.722818    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca295cf6_a5a2_4f3d_935b_e7ce38b8d65a.slice/crio-d9414dba1864fb67b22abe1016a53a284e57b4d35e23aac08aa60cd5bf2d5e99 WatchSource:0}: Error finding container d9414dba1864fb67b22abe1016a53a284e57b4d35e23aac08aa60cd5bf2d5e99: Status 404 returned error can't find the container with id d9414dba1864fb67b22abe1016a53a284e57b4d35e23aac08aa60cd5bf2d5e99
Sep 07 21:02:03.759606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.759583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:03.759733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.759623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:03.759733 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.759727    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:03.759844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.759742    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:03.759844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.759760    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:03.759844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.759777    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:04.759761678 +0000 UTC m=+36.595887766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:03.759844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:03.759813    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:04.759797039 +0000 UTC m=+36.595923142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:03.967954 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.967908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerStarted","Data":"49a7b79581493e27d62f0e913f14b0299718810120874831566f1a14119548fa"}
Sep 07 21:02:03.969257 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:03.969231    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-swbg5" event={"ID":"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a","Type":"ContainerStarted","Data":"d9414dba1864fb67b22abe1016a53a284e57b4d35e23aac08aa60cd5bf2d5e99"}
Sep 07 21:02:04.637474 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:04.637432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:04.768514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:04.768483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:04.768691 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:04.768526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:04.768691 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:04.768654    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:04.768691 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:04.768675    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:04.768826 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:04.768692    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:04.768826 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:04.768732    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:06.768715882 +0000 UTC m=+38.604841964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:04.768826 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:04.768744    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:06.768739037 +0000 UTC m=+38.604865120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:04.974706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:04.974667    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="49a7b79581493e27d62f0e913f14b0299718810120874831566f1a14119548fa" exitCode=0
Sep 07 21:02:04.975188 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:04.974710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"49a7b79581493e27d62f0e913f14b0299718810120874831566f1a14119548fa"}
Sep 07 21:02:05.982011 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:05.981969    2583 generic.go:356] "Generic (PLEG): container finished" podID="5050c00c-189d-4d45-97c3-54a86ae5a3be" containerID="baa83bbec966768385d4ede56a4bc9c9dabd95247efc7accc7382ba5d8ec6c2a" exitCode=0
Sep 07 21:02:05.982570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:05.982047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerDied","Data":"baa83bbec966768385d4ede56a4bc9c9dabd95247efc7accc7382ba5d8ec6c2a"}
Sep 07 21:02:06.603500 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.603475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:06.661326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.661288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:06.783889 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.783852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:06.784051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.783975    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:06.784051 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:06.784028    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:06.784154 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:06.784076    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:06.784154 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:06.784088    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:06.784154 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:06.784101    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:10.784080972 +0000 UTC m=+42.620207076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:06.784154 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:06.784122    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:10.784109287 +0000 UTC m=+42.620235373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:06.988753 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.988715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glm7g" event={"ID":"5050c00c-189d-4d45-97c3-54a86ae5a3be","Type":"ContainerStarted","Data":"e343a210b2df3a91d2d2b9de42fdc430da27a7edc992b678273a3c333a1de194"}
Sep 07 21:02:06.990724 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:06.990697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-swbg5" event={"ID":"ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a","Type":"ContainerStarted","Data":"df8c19c2a3631468719ae25c719eb59560980493d97aab9932471aa1aee7a3ea"}
Sep 07 21:02:07.008965 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.008880    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-glm7g" podStartSLOduration=8.520078945 podStartE2EDuration="38.008859014s" totalImagesPullingTime="29.488780069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:07.007855994 +0000 UTC m=+38.843982099" watchObservedRunningTime="2026-09-07 21:02:07.008859014 +0000 UTC m=+38.844985120"
Sep 07 21:02:07.028792 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.028738    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-swbg5" podStartSLOduration=1.189211066 podStartE2EDuration="4.028716443s" totalImagesPullingTime="2.839505377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:07.023853103 +0000 UTC m=+38.859979207" watchObservedRunningTime="2026-09-07 21:02:07.028716443 +0000 UTC m=+38.864842549"
Sep 07 21:02:07.138812 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.138776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:07.240137 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.240062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:07.561582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.561502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:07.627277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.627235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:07.944498 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:07.944464    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:08.045582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:08.045549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:08.280121 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:08.280040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:09.675562 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:09.675523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:09.774149 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:09.774116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:10.654808 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:10.654764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:10.713287 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:10.713249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:10.814486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:10.814451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:10.814667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:10.814532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:10.814667 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:10.814616    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:10.814667 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:10.814629    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:10.814667 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:10.814641    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:10.814809 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:10.814692    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:18.814672059 +0000 UTC m=+50.650798142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:10.814809 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:10.814705    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:18.814699766 +0000 UTC m=+50.650825849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:11.569777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:11.569748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:14.598356 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:14.598321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:15.343693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:15.343655    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:15.442979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:15.442933    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:18.871833 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:18.871800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:18.871846    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:18.871953    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:18.871977    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:18.872029    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.872014464 +0000 UTC m=+66.708140547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:18.871960    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:18.872235 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:18.872080    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:34.872065725 +0000 UTC m=+66.708191808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:19.241045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:19.241009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:20.635428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:20.635387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:20.692522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:20.692483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:21.915126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:21.915091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:22.017107 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:22.017069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:23.734623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:23.734592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:23.835559 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:23.835531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:24.728052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:24.728019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:24.830269 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:24.830235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:27.217164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:27.217127    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:27.276734 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:27.276705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:29.962293 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:29.962267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w65b9"
Sep 07 21:02:30.121207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:30.121173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:30.176334 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:30.176294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:34.376569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.376522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:34.376996 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.376599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:02:34.379947 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.379920    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 21:02:34.380020 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.379924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 21:02:34.387318 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.387297    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 07 21:02:34.387412 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.387355    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs podName:b7700639-a809-449f-b7d6-38b6d2872fc7 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:38.387339102 +0000 UTC m=+130.223465184 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs") pod "network-metrics-daemon-8xdwm" (UID: "b7700639-a809-449f-b7d6-38b6d2872fc7") : secret "metrics-daemon-secret" not found
Sep 07 21:02:34.390652 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.390627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7d8d215-3588-47cf-bb08-70e0c12ccf40-original-pull-secret\") pod \"global-pull-secret-syncer-rhzxb\" (UID: \"b7d8d215-3588-47cf-bb08-70e0c12ccf40\") " pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:34.578357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.578321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:34.581618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.581601    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 21:02:34.590987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.590958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 21:02:34.591119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.591103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhzxb"
Sep 07 21:02:34.601426 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.601400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfzn\" (UniqueName: \"kubernetes.io/projected/ec736dc7-0375-4bd6-bd03-bc58ceaff2e7-kube-api-access-cdfzn\") pod \"network-check-target-2ddbn\" (UID: \"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7\") " pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:34.880925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.880879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:02:34.881125 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.880969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:02:34.881125 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.881056    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 21:02:34.881125 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.881077    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c9c58c794-9gsfb: secret "image-registry-tls" not found
Sep 07 21:02:34.881259 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.881133    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls podName:58748c75-51de-48fc-8679-6a1fc5c4c571 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:06.881116075 +0000 UTC m=+98.717242157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls") pod "image-registry-5c9c58c794-9gsfb" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571") : secret "image-registry-tls" not found
Sep 07 21:02:34.881259 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.881060    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 21:02:34.881259 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:34.881224    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls podName:5dcd1cd7-18be-403b-97e4-0ed075627055 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:06.881200289 +0000 UTC m=+98.717326388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls") pod "dns-default-cf2p8" (UID: "5dcd1cd7-18be-403b-97e4-0ed075627055") : secret "dns-default-metrics-tls" not found
Sep 07 21:02:34.883908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.883890    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xs9mt\""
Sep 07 21:02:34.891490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.891436    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:34.902522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:34.902490    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhzxb"]
Sep 07 21:02:34.905375 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:34.905353    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d8d215_3588_47cf_bb08_70e0c12ccf40.slice/crio-72f718d0e0f13cc5277d08f4ed193e99a8b110de31e51151803ddb99f6b6229f WatchSource:0}: Error finding container 72f718d0e0f13cc5277d08f4ed193e99a8b110de31e51151803ddb99f6b6229f: Status 404 returned error can't find the container with id 72f718d0e0f13cc5277d08f4ed193e99a8b110de31e51151803ddb99f6b6229f
Sep 07 21:02:35.055852 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:35.055814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhzxb" event={"ID":"b7d8d215-3588-47cf-bb08-70e0c12ccf40","Type":"ContainerStarted","Data":"72f718d0e0f13cc5277d08f4ed193e99a8b110de31e51151803ddb99f6b6229f"}
Sep 07 21:02:35.161733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:35.161702    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ddbn"]
Sep 07 21:02:35.164563 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:35.164535    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec736dc7_0375_4bd6_bd03_bc58ceaff2e7.slice/crio-bafba871274d5af125126ddd09943658f1a187562ec55fa28067330f7c896c74 WatchSource:0}: Error finding container bafba871274d5af125126ddd09943658f1a187562ec55fa28067330f7c896c74: Status 404 returned error can't find the container with id bafba871274d5af125126ddd09943658f1a187562ec55fa28067330f7c896c74
Sep 07 21:02:36.060093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:36.060028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ddbn" event={"ID":"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7","Type":"ContainerStarted","Data":"bafba871274d5af125126ddd09943658f1a187562ec55fa28067330f7c896c74"}
Sep 07 21:02:40.072368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.072329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhzxb" event={"ID":"b7d8d215-3588-47cf-bb08-70e0c12ccf40","Type":"ContainerStarted","Data":"d283af505c8730d3459b78c1fa2f415d16953bf171c2a7b47c17b166a8db2b8d"}
Sep 07 21:02:40.073840 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.073813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ddbn" event={"ID":"ec736dc7-0375-4bd6-bd03-bc58ceaff2e7","Type":"ContainerStarted","Data":"6423d41cad3f44605f5a9d8fdfb2ed90e1c61577bbfb15fa64d3772c06fcd13f"}
Sep 07 21:02:40.073993 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.073974    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:02:40.089125 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.089087    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rhzxb" podStartSLOduration=66.414545253 podStartE2EDuration="1m11.089073335s" totalImagesPullingTime="4.674528082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:40.088538325 +0000 UTC m=+71.924664429" watchObservedRunningTime="2026-09-07 21:02:40.089073335 +0000 UTC m=+71.925199438"
Sep 07 21:02:40.105425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.105381    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2ddbn" podStartSLOduration=66.69382732 podStartE2EDuration="1m11.105366543s" totalImagesPullingTime="4.411539223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:40.104630446 +0000 UTC m=+71.940756564" watchObservedRunningTime="2026-09-07 21:02:40.105366543 +0000 UTC m=+71.941492646"
Sep 07 21:02:40.394180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.394099    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-c6cvr"]
Sep 07 21:02:40.402063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.402042    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"]
Sep 07 21:02:40.402183 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.402167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr"
Sep 07 21:02:40.404667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.404650    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2vmn5\""
Sep 07 21:02:40.409351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.409331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.409677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.409656    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-c6cvr"]
Sep 07 21:02:40.412803 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.412786    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 07 21:02:40.413559 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.413543    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.413796 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.413776    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 07 21:02:40.414421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.414401    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.414834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.414811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8kgvh\""
Sep 07 21:02:40.416801 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.416782    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"]
Sep 07 21:02:40.526390 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.526357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6bq\" (UniqueName: \"kubernetes.io/projected/a35adee1-d31e-4c91-827c-ac35c96d542d-kube-api-access-mg6bq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.526544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.526421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a35adee1-d31e-4c91-827c-ac35c96d542d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.526544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.526447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxfw\" (UniqueName: \"kubernetes.io/projected/fc93d173-ceca-4af7-88ad-3ae9e246e5ad-kube-api-access-vwxfw\") pod \"network-check-source-685456655f-c6cvr\" (UID: \"fc93d173-ceca-4af7-88ad-3ae9e246e5ad\") " pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr"
Sep 07 21:02:40.526544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.526511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a35adee1-d31e-4c91-827c-ac35c96d542d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.627152 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.627117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a35adee1-d31e-4c91-827c-ac35c96d542d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.627290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.627157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6bq\" (UniqueName: \"kubernetes.io/projected/a35adee1-d31e-4c91-827c-ac35c96d542d-kube-api-access-mg6bq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.627290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.627211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a35adee1-d31e-4c91-827c-ac35c96d542d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.627290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.627241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxfw\" (UniqueName: \"kubernetes.io/projected/fc93d173-ceca-4af7-88ad-3ae9e246e5ad-kube-api-access-vwxfw\") pod \"network-check-source-685456655f-c6cvr\" (UID: \"fc93d173-ceca-4af7-88ad-3ae9e246e5ad\") " pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr"
Sep 07 21:02:40.627748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.627725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a35adee1-d31e-4c91-827c-ac35c96d542d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.629388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.629368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a35adee1-d31e-4c91-827c-ac35c96d542d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.636068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.636044    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxfw\" (UniqueName: \"kubernetes.io/projected/fc93d173-ceca-4af7-88ad-3ae9e246e5ad-kube-api-access-vwxfw\") pod \"network-check-source-685456655f-c6cvr\" (UID: \"fc93d173-ceca-4af7-88ad-3ae9e246e5ad\") " pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr"
Sep 07 21:02:40.636183 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.636165    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6bq\" (UniqueName: \"kubernetes.io/projected/a35adee1-d31e-4c91-827c-ac35c96d542d-kube-api-access-mg6bq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-plvwf\" (UID: \"a35adee1-d31e-4c91-827c-ac35c96d542d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.710758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.710727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr"
Sep 07 21:02:40.718553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.718531    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"
Sep 07 21:02:40.729717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.729680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:40.830121 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.830091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:40.981285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.981200    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-c6cvr"]
Sep 07 21:02:40.984051 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:40.984023    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc93d173_ceca_4af7_88ad_3ae9e246e5ad.slice/crio-3b4d6649a6dcf4823fff024053bd3c5f82ff62ef9c457329c68ac0b4683355ba WatchSource:0}: Error finding container 3b4d6649a6dcf4823fff024053bd3c5f82ff62ef9c457329c68ac0b4683355ba: Status 404 returned error can't find the container with id 3b4d6649a6dcf4823fff024053bd3c5f82ff62ef9c457329c68ac0b4683355ba
Sep 07 21:02:40.984141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:40.984105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf"]
Sep 07 21:02:40.989090 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:40.989061    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35adee1_d31e_4c91_827c_ac35c96d542d.slice/crio-1156110c11345cdb2859b757b68f94e2f9434612712da281f0accbe9bd098f71 WatchSource:0}: Error finding container 1156110c11345cdb2859b757b68f94e2f9434612712da281f0accbe9bd098f71: Status 404 returned error can't find the container with id 1156110c11345cdb2859b757b68f94e2f9434612712da281f0accbe9bd098f71
Sep 07 21:02:41.081431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:41.081392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr" event={"ID":"fc93d173-ceca-4af7-88ad-3ae9e246e5ad","Type":"ContainerStarted","Data":"281bfc0ed3875e7fe8aa1a2699972014961a0c4764b6b35a07d2895c08d5f78d"}
Sep 07 21:02:41.081846 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:41.081491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr" event={"ID":"fc93d173-ceca-4af7-88ad-3ae9e246e5ad","Type":"ContainerStarted","Data":"3b4d6649a6dcf4823fff024053bd3c5f82ff62ef9c457329c68ac0b4683355ba"}
Sep 07 21:02:41.082614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:41.082591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf" event={"ID":"a35adee1-d31e-4c91-827c-ac35c96d542d","Type":"ContainerStarted","Data":"1156110c11345cdb2859b757b68f94e2f9434612712da281f0accbe9bd098f71"}
Sep 07 21:02:41.100206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:41.100161    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-c6cvr" podStartSLOduration=1.100148153 podStartE2EDuration="1.100148153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:41.099545924 +0000 UTC m=+72.935672027" watchObservedRunningTime="2026-09-07 21:02:41.100148153 +0000 UTC m=+72.936274257"
Sep 07 21:02:43.090714 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.090624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf" event={"ID":"a35adee1-d31e-4c91-827c-ac35c96d542d","Type":"ContainerStarted","Data":"9bc6af421df764c3ef3677f4ef70c7983a4581e2ba55e5a936990973e5976749"}
Sep 07 21:02:43.107845 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.107796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf" podStartSLOduration=1.343666774 podStartE2EDuration="3.107781007s" totalImagesPullingTime="1.764114233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:43.107374713 +0000 UTC m=+74.943500818" watchObservedRunningTime="2026-09-07 21:02:43.107781007 +0000 UTC m=+74.943907140"
Sep 07 21:02:43.704240 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.704206    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k5vcp"]
Sep 07 21:02:43.706198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.706182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.708772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.708750    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 21:02:43.709399 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.709382    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 21:02:43.709494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.709409    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vvs4x\""
Sep 07 21:02:43.709494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.709427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 21:02:43.709494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.709410    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 21:02:43.722275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.722253    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5vcp"]
Sep 07 21:02:43.731223 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.731202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:43.750004 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.749977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-crio-socket\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.750103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.750019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdctr\" (UniqueName: \"kubernetes.io/projected/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-api-access-mdctr\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.750103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.750042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-data-volume\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.750103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.750092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.750238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.750133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.823521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.823490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:43.850718 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.850850 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-crio-socket\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.850850 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:43.850791    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:43.850850 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdctr\" (UniqueName: \"kubernetes.io/projected/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-api-access-mdctr\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.850850 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:43.850850    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.350833952 +0000 UTC m=+76.186960040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:43.851051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-crio-socket\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.851051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-data-volume\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.851051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.850959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.851051 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:43.851045    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:43.851244 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:43.851084    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:44.35106838 +0000 UTC m=+76.187194463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:43.851331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.851313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-data-volume\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.865486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.865460    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdctr\" (UniqueName: \"kubernetes.io/projected/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-api-access-mdctr\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:43.952613 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.952570    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"]
Sep 07 21:02:43.954590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.954551    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"
Sep 07 21:02:43.957225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.957201    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-28px6\""
Sep 07 21:02:43.957523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.957505    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 21:02:43.957720 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.957706    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:43.959110 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.959082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:43.969338 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:43.969321    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"]
Sep 07 21:02:44.030090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.030055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:44.052074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.052042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpbs\" (UniqueName: \"kubernetes.io/projected/fb76871d-8a5a-4223-aaab-6501ae381e19-kube-api-access-lfpbs\") pod \"migrator-fdbb8fdff-rntxj\" (UID: \"fb76871d-8a5a-4223-aaab-6501ae381e19\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"
Sep 07 21:02:44.141636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.141603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:44.153193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.153171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpbs\" (UniqueName: \"kubernetes.io/projected/fb76871d-8a5a-4223-aaab-6501ae381e19-kube-api-access-lfpbs\") pod \"migrator-fdbb8fdff-rntxj\" (UID: \"fb76871d-8a5a-4223-aaab-6501ae381e19\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"
Sep 07 21:02:44.161467 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.161441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpbs\" (UniqueName: \"kubernetes.io/projected/fb76871d-8a5a-4223-aaab-6501ae381e19-kube-api-access-lfpbs\") pod \"migrator-fdbb8fdff-rntxj\" (UID: \"fb76871d-8a5a-4223-aaab-6501ae381e19\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"
Sep 07 21:02:44.263420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.263342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"
Sep 07 21:02:44.355686 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.355658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:44.355806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.355695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:44.355806 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:44.355790    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:44.355873 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:44.355808    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:44.355873 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:44.355846    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:45.355831081 +0000 UTC m=+77.191957164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:44.355873 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:44.355858    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:45.355853165 +0000 UTC m=+77.191979247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:44.534378 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.534351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj"]
Sep 07 21:02:44.536669 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:02:44.536643    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb76871d_8a5a_4223_aaab_6501ae381e19.slice/crio-4bd8e1b84daba55c5be29d749a6485369f71f5afdba79c281652dae093287435 WatchSource:0}: Error finding container 4bd8e1b84daba55c5be29d749a6485369f71f5afdba79c281652dae093287435: Status 404 returned error can't find the container with id 4bd8e1b84daba55c5be29d749a6485369f71f5afdba79c281652dae093287435
Sep 07 21:02:44.639141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.639088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:44.743811 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.743775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:44.840227 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:44.840141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:45.098619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.098535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj" event={"ID":"fb76871d-8a5a-4223-aaab-6501ae381e19","Type":"ContainerStarted","Data":"4bd8e1b84daba55c5be29d749a6485369f71f5afdba79c281652dae093287435"}
Sep 07 21:02:45.249133 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.249098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:45.338286 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.338251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:45.365731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.365646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:45.365731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.365699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:45.365934 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:45.365825    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:45.365934 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:45.365851    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:45.365934 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:45.365899    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:47.365878911 +0000 UTC m=+79.202005007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:45.365934 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:45.365920    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:47.3659097 +0000 UTC m=+79.202035790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:45.677624 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.677598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:45.777582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.777550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:45.846255 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.846230    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wjvl5_26b804cf-cddc-43ef-9758-86844dd929b2/dns-node-resolver/0.log"
Sep 07 21:02:45.940140 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:45.940107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:46.036465 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.036430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:46.103384 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.103350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj" event={"ID":"fb76871d-8a5a-4223-aaab-6501ae381e19","Type":"ContainerStarted","Data":"30b17e2788405fae5a83b22648d472e9d8cc84ea7f104756a0c4cb5add7ddc72"}
Sep 07 21:02:46.103569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.103404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj" event={"ID":"fb76871d-8a5a-4223-aaab-6501ae381e19","Type":"ContainerStarted","Data":"ac65e0b5d98469a6643eed5849e64c573e6e100dd9e91d7de325f07f9c8ecb6a"}
Sep 07 21:02:46.122383 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.122337    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-rntxj" podStartSLOduration=2.118585394 podStartE2EDuration="3.122322038s" totalImagesPullingTime="1.003736644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:46.121790558 +0000 UTC m=+77.957916663" watchObservedRunningTime="2026-09-07 21:02:46.122322038 +0000 UTC m=+77.958448140"
Sep 07 21:02:46.204652 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.204583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:46.273381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.273350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:46.446819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:46.446799    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xlvw_9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6/node-ca/0.log"
Sep 07 21:02:47.381866 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.381827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:47.382263 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.381914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:47.382263 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:47.381973    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:47.382263 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:47.382033    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:47.382263 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:47.382043    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:51.382027955 +0000 UTC m=+83.218154053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:47.382263 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:47.382078    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:51.382067572 +0000 UTC m=+83.218193658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:47.445317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.445290    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-swbg5_ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a/serve-healthcheck-canary/0.log"
Sep 07 21:02:47.567160 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.567133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:47.638858 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.638795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:47.732404 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.732369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:47.833035 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:47.833005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:49.416951 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:49.416913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:49.631973 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:49.631931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:49.776159 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:49.776089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:49.881182 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:49.881148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:49.980671 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:49.980635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:50.085195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:50.085114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:50.322584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:50.322551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:50.919052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:50.919017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:51.136916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:51.136814    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:51.409851 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:51.409816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:51.410009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:51.409864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:51.410009 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:51.409988    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:51.410077 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:51.410046    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:59.410032298 +0000 UTC m=+91.246158381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:51.410077 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:51.409987    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 21:02:51.410144 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:51.410084    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:02:59.410076113 +0000 UTC m=+91.246202199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : configmap "kube-rbac-proxy" not found
Sep 07 21:02:51.507599 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:51.507566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:51.906109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:51.906079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:52.111713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:52.111684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:52.708696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:52.708659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:53.113222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:53.113142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:53.315394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:53.315367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:53.532919 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:53.532891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:53.632736 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:53.632705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:53.733821 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:53.733785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:54.320434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:54.320390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:54.419388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:54.419353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:54.915437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:54.915403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:55.117298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:55.117265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:55.500064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:55.500029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:55.706653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:55.706614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:55.887270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:55.887187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:56.108144 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:56.108112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:56.710208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:56.710170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:56.828740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:56.828705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:57.100932 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:57.100845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:57.304912 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:57.304880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:57.706929 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:57.706887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:58.299671 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:58.299637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:58.702394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:58.702364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:59.103068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.102983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:59.473632 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.473599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:59.474012 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.473638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:59.474012 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:59.473743    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:59.474012 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:02:59.473802    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls podName:9a3e92a7-a14d-454c-ae94-7faa7e3182d8 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:15.473786934 +0000 UTC m=+107.309913016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k5vcp" (UID: "9a3e92a7-a14d-454c-ae94-7faa7e3182d8") : secret "insights-runtime-extractor-tls" not found
Sep 07 21:02:59.474132 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.474122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:02:59.504377 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.504341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:02:59.906293 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:02:59.906258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:00.111633 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:00.111601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:00.213905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:00.213817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:00.316958 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:00.316904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:00.416084 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:00.416051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:04.780268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:04.780237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:04.880336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:04.880302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:04.960920 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:04.960887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:05.092643 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:05.092568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:05.472219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:05.472186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:05.554121 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:05.554091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:06.656145 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.656101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:06.829719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.829682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:06.886167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.886131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:06.928777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.928697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:06.928777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.928749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:03:06.931116 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.931082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dcd1cd7-18be-403b-97e4-0ed075627055-metrics-tls\") pod \"dns-default-cf2p8\" (UID: \"5dcd1cd7-18be-403b-97e4-0ed075627055\") " pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:03:06.931296 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.931277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"image-registry-5c9c58c794-9gsfb\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") " pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:06.944345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.944318    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqps2\""
Sep 07 21:03:06.952200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.952176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:06.953422 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.953404    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7njqf\""
Sep 07 21:03:06.961367 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:06.961343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:03:07.228928 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:07.228854    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:03:07.232419 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:07.232388    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58748c75_51de_48fc_8679_6a1fc5c4c571.slice/crio-6efc99c217ea45d549c7a94e8efe160b4a085365d44cfa84b0bd730d6e9f254e WatchSource:0}: Error finding container 6efc99c217ea45d549c7a94e8efe160b4a085365d44cfa84b0bd730d6e9f254e: Status 404 returned error can't find the container with id 6efc99c217ea45d549c7a94e8efe160b4a085365d44cfa84b0bd730d6e9f254e
Sep 07 21:03:07.232521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:07.232420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf2p8"]
Sep 07 21:03:07.235155 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:07.235136    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcd1cd7_18be_403b_97e4_0ed075627055.slice/crio-9b796841514248e514d5817bccc2a86284605df8c35cc6ee327ca4ab30c5bfc3 WatchSource:0}: Error finding container 9b796841514248e514d5817bccc2a86284605df8c35cc6ee327ca4ab30c5bfc3: Status 404 returned error can't find the container with id 9b796841514248e514d5817bccc2a86284605df8c35cc6ee327ca4ab30c5bfc3
Sep 07 21:03:07.996481 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:07.996436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:08.041337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.041304    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"]
Sep 07 21:03:08.043518 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.043494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.046603 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.046567    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 21:03:08.047429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.047172    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bbfbp\""
Sep 07 21:03:08.047429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.047194    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 21:03:08.047429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.047199    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 21:03:08.047761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.047741    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 07 21:03:08.072469 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.072442    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"]
Sep 07 21:03:08.138282 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.138244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qwf\" (UniqueName: \"kubernetes.io/projected/ef7da4bd-731e-4a05-a60d-aea4968f10bd-kube-api-access-c6qwf\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.138471 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.138304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7da4bd-731e-4a05-a60d-aea4968f10bd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.146556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.146518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:08.148096 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.148078    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-76lzs"]
Sep 07 21:03:08.149977 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.149958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:08.154373 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.154348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6b8kl\""
Sep 07 21:03:08.154471 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.154382    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 21:03:08.156322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.156300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 21:03:08.167362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.167318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-76lzs"]
Sep 07 21:03:08.169238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.169209    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" event={"ID":"58748c75-51de-48fc-8679-6a1fc5c4c571","Type":"ContainerStarted","Data":"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"}
Sep 07 21:03:08.169339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.169260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" event={"ID":"58748c75-51de-48fc-8679-6a1fc5c4c571","Type":"ContainerStarted","Data":"6efc99c217ea45d549c7a94e8efe160b4a085365d44cfa84b0bd730d6e9f254e"}
Sep 07 21:03:08.169339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.169285    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:08.171117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.171081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf2p8" event={"ID":"5dcd1cd7-18be-403b-97e4-0ed075627055","Type":"ContainerStarted","Data":"9b796841514248e514d5817bccc2a86284605df8c35cc6ee327ca4ab30c5bfc3"}
Sep 07 21:03:08.224921 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.224866    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" podStartSLOduration=99.224750993 podStartE2EDuration="1m39.224750993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:08.224637492 +0000 UTC m=+100.060763618" watchObservedRunningTime="2026-09-07 21:03:08.224750993 +0000 UTC m=+100.060877097"
Sep 07 21:03:08.238979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.238926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbczc\" (UniqueName: \"kubernetes.io/projected/b8eb7844-e908-4fc0-b5a0-505726caad1b-kube-api-access-bbczc\") pod \"downloads-85d98c998f-76lzs\" (UID: \"b8eb7844-e908-4fc0-b5a0-505726caad1b\") " pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:08.239109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.239007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7da4bd-731e-4a05-a60d-aea4968f10bd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.239109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.239055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qwf\" (UniqueName: \"kubernetes.io/projected/ef7da4bd-731e-4a05-a60d-aea4968f10bd-kube-api-access-c6qwf\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.241413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.241390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef7da4bd-731e-4a05-a60d-aea4968f10bd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.249503 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.249447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qwf\" (UniqueName: \"kubernetes.io/projected/ef7da4bd-731e-4a05-a60d-aea4968f10bd-kube-api-access-c6qwf\") pod \"managed-serviceaccount-addon-agent-7fc8f547b8-k8t64\" (UID: \"ef7da4bd-731e-4a05-a60d-aea4968f10bd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.289749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.289704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:08.340389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.340280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbczc\" (UniqueName: \"kubernetes.io/projected/b8eb7844-e908-4fc0-b5a0-505726caad1b-kube-api-access-bbczc\") pod \"downloads-85d98c998f-76lzs\" (UID: \"b8eb7844-e908-4fc0-b5a0-505726caad1b\") " pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:08.358647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.358619    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbczc\" (UniqueName: \"kubernetes.io/projected/b8eb7844-e908-4fc0-b5a0-505726caad1b-kube-api-access-bbczc\") pod \"downloads-85d98c998f-76lzs\" (UID: \"b8eb7844-e908-4fc0-b5a0-505726caad1b\") " pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:08.360431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.360408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"
Sep 07 21:03:08.412804 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.412315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:08.459610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.459572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:08.631733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.631695    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64"]
Sep 07 21:03:08.733780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:08.733659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-76lzs"]
Sep 07 21:03:08.955876 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:08.955842    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef7da4bd_731e_4a05_a60d_aea4968f10bd.slice/crio-0f4e64122a4abe45e4bb38ff1255550df566c540a1d87173e8000967fa4e3d53 WatchSource:0}: Error finding container 0f4e64122a4abe45e4bb38ff1255550df566c540a1d87173e8000967fa4e3d53: Status 404 returned error can't find the container with id 0f4e64122a4abe45e4bb38ff1255550df566c540a1d87173e8000967fa4e3d53
Sep 07 21:03:08.956741 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:08.956712    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eb7844_e908_4fc0_b5a0_505726caad1b.slice/crio-f16526b323a7cbf8658d8481d01e1c1e89da762d14dce663d6ddec54889aec13 WatchSource:0}: Error finding container f16526b323a7cbf8658d8481d01e1c1e89da762d14dce663d6ddec54889aec13: Status 404 returned error can't find the container with id f16526b323a7cbf8658d8481d01e1c1e89da762d14dce663d6ddec54889aec13
Sep 07 21:03:09.176240 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:09.176204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf2p8" event={"ID":"5dcd1cd7-18be-403b-97e4-0ed075627055","Type":"ContainerStarted","Data":"b40ec94ac2d81475a837a309b877c63bc508c9f5c1d17793ace65c6a3fe66826"}
Sep 07 21:03:09.176623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:09.176257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf2p8" event={"ID":"5dcd1cd7-18be-403b-97e4-0ed075627055","Type":"ContainerStarted","Data":"6189a3f24ce9dcfda7c0f9a0fffd14848948ce0ea79681acb5603ae2f6b933af"}
Sep 07 21:03:09.176623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:09.176324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:03:09.177466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:09.177444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-76lzs" event={"ID":"b8eb7844-e908-4fc0-b5a0-505726caad1b","Type":"ContainerStarted","Data":"f16526b323a7cbf8658d8481d01e1c1e89da762d14dce663d6ddec54889aec13"}
Sep 07 21:03:09.178501 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:09.178479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64" event={"ID":"ef7da4bd-731e-4a05-a60d-aea4968f10bd","Type":"ContainerStarted","Data":"0f4e64122a4abe45e4bb38ff1255550df566c540a1d87173e8000967fa4e3d53"}
Sep 07 21:03:11.086192 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:11.086159    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2ddbn"
Sep 07 21:03:11.103120 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:11.103060    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cf2p8" podStartSLOduration=67.360662214 podStartE2EDuration="1m9.103011601s" totalImagesPullingTime="1.742349387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:09.20443933 +0000 UTC m=+101.040565432" watchObservedRunningTime="2026-09-07 21:03:11.103011601 +0000 UTC m=+102.939137706"
Sep 07 21:03:12.194118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:12.193996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64" event={"ID":"ef7da4bd-731e-4a05-a60d-aea4968f10bd","Type":"ContainerStarted","Data":"1806b0fc721b851682de2f58b88b1e91b95b9a20ee2a3e041333c7f54453a528"}
Sep 07 21:03:12.211279 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:12.211226    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fc8f547b8-k8t64" podStartSLOduration=1.584082266 podStartE2EDuration="4.211211548s" totalImagesPullingTime="2.627129282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:12.209442826 +0000 UTC m=+104.045568931" watchObservedRunningTime="2026-09-07 21:03:12.211211548 +0000 UTC m=+104.047337655"
Sep 07 21:03:13.468677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:13.468636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:13.522292 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:13.522249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:14.903312 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.903277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:14.943058 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.943029    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:14.971825 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.971788    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:14.972054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.971922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:14.974228 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.974201    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 21:03:14.974228 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.974223    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 21:03:14.974640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.974471    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 21:03:14.974640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.974535    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 21:03:14.975214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.975195    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrrkg\""
Sep 07 21:03:14.975348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.975327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 21:03:14.990974 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:14.990912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.059521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.059483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.065837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.065810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"]
Sep 07 21:03:15.087722 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.087688    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"]
Sep 07 21:03:15.087911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.087783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:15.090371 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.090348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-khbt4\""
Sep 07 21:03:15.090487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.090392    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 21:03:15.095380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.095380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.095380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.095585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.095585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095506    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.095585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.095552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz97k\" (UniqueName: \"kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.120815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.120783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.196862 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.196816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197062 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.196872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197062 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.196909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197179 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b2503f3-4532-4231-9f99-995720104b09-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ltc6p\" (UID: \"6b2503f3-4532-4231-9f99-995720104b09\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:15.197179 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197276 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz97k\" (UniqueName: \"kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197747    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.197982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.197967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.199616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.199593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.199763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.199731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.205780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.205758    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz97k\" (UniqueName: \"kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k\") pod \"console-66549bc4bd-bqfhp\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") " pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.268109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.268070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.282915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.282887    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:15.298202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.298179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b2503f3-4532-4231-9f99-995720104b09-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ltc6p\" (UID: \"6b2503f3-4532-4231-9f99-995720104b09\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:15.300955 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.300917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6b2503f3-4532-4231-9f99-995720104b09-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ltc6p\" (UID: \"6b2503f3-4532-4231-9f99-995720104b09\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:15.398434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.398400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:15.499103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.499070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:03:15.501713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.501653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a3e92a7-a14d-454c-ae94-7faa7e3182d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k5vcp\" (UID: \"9a3e92a7-a14d-454c-ae94-7faa7e3182d8\") " pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:03:15.514633 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.514611    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k5vcp"
Sep 07 21:03:15.587730 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.587701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:15.593828 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:15.593789    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode075ffd3_ea92_4956_a72a_d75b2394d2d1.slice/crio-b0feaed439721307557da68e0126101e1a06f4252bc1da7883ef62302b7a2b81 WatchSource:0}: Error finding container b0feaed439721307557da68e0126101e1a06f4252bc1da7883ef62302b7a2b81: Status 404 returned error can't find the container with id b0feaed439721307557da68e0126101e1a06f4252bc1da7883ef62302b7a2b81
Sep 07 21:03:15.685547 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.685469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.707851 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.707821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"]
Sep 07 21:03:15.710653 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:15.710628    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2503f3_4532_4231_9f99_995720104b09.slice/crio-5baed2e86f24cc12cd7dd83847c6134bc6a918ac5f0e3ed167aa00df954e14a7 WatchSource:0}: Error finding container 5baed2e86f24cc12cd7dd83847c6134bc6a918ac5f0e3ed167aa00df954e14a7: Status 404 returned error can't find the container with id 5baed2e86f24cc12cd7dd83847c6134bc6a918ac5f0e3ed167aa00df954e14a7
Sep 07 21:03:15.786383 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.786254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:15.817779 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:15.817747    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k5vcp"]
Sep 07 21:03:15.820629 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:15.820598    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3e92a7_a14d_454c_ae94_7faa7e3182d8.slice/crio-b5b6e73e5ea5575bd290d500aedbddc31843f7949eadad705e6998673fb02de3 WatchSource:0}: Error finding container b5b6e73e5ea5575bd290d500aedbddc31843f7949eadad705e6998673fb02de3: Status 404 returned error can't find the container with id b5b6e73e5ea5575bd290d500aedbddc31843f7949eadad705e6998673fb02de3
Sep 07 21:03:16.213345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:16.213308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5vcp" event={"ID":"9a3e92a7-a14d-454c-ae94-7faa7e3182d8","Type":"ContainerStarted","Data":"9c86217f6ed90e503a6bb6b076920e203e1f910fd69bee3d4bb3f3d6b5daf646"}
Sep 07 21:03:16.213844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:16.213384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5vcp" event={"ID":"9a3e92a7-a14d-454c-ae94-7faa7e3182d8","Type":"ContainerStarted","Data":"b5b6e73e5ea5575bd290d500aedbddc31843f7949eadad705e6998673fb02de3"}
Sep 07 21:03:16.215173 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:16.215143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p" event={"ID":"6b2503f3-4532-4231-9f99-995720104b09","Type":"ContainerStarted","Data":"5baed2e86f24cc12cd7dd83847c6134bc6a918ac5f0e3ed167aa00df954e14a7"}
Sep 07 21:03:16.216504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:16.216471    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66549bc4bd-bqfhp" event={"ID":"e075ffd3-ea92-4956-a72a-d75b2394d2d1","Type":"ContainerStarted","Data":"b0feaed439721307557da68e0126101e1a06f4252bc1da7883ef62302b7a2b81"}
Sep 07 21:03:17.138214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:17.138007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:17.240409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:17.240278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:18.227339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:18.227039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p" event={"ID":"6b2503f3-4532-4231-9f99-995720104b09","Type":"ContainerStarted","Data":"0d9e432ab4d80ed056a8a1f9ff78d2e01f7a475fb9af94f3f5d1f6455d2ac120"}
Sep 07 21:03:18.227339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:18.227288    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:18.230208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:18.230176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5vcp" event={"ID":"9a3e92a7-a14d-454c-ae94-7faa7e3182d8","Type":"ContainerStarted","Data":"669f1f832d498ec104f5921fc981c9a8ad26bc8e625b585cbbea26f79365fe5a"}
Sep 07 21:03:18.233282 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:18.233258    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p"
Sep 07 21:03:18.242346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:18.242299    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ltc6p" podStartSLOduration=1.73767951 podStartE2EDuration="3.242280023s" totalImagesPullingTime="1.504600513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:18.241488111 +0000 UTC m=+110.077614215" watchObservedRunningTime="2026-09-07 21:03:18.242280023 +0000 UTC m=+110.078406127"
Sep 07 21:03:19.107288 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:19.107246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:19.186784 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:19.186653    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cf2p8"
Sep 07 21:03:19.193731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:19.193701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:19.472978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:19.472912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:20.003277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:20.003231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:22.743262 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:22.743229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:23.280123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.280090    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:23.381451 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.381413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:23.468112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.468079    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:03:23.471361 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.471341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.479218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.479019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 21:03:23.484039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.484018    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:03:23.562565 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6567\" (UniqueName: \"kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562565 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.562759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.562758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663252 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6567\" (UniqueName: \"kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663529 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663529 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663516    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.663608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.663582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.664058 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.664036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.664250 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.664207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.664355 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.664299    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.664629 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.664592    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.665968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.665933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.666525 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.666503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.671293 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.671254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6567\" (UniqueName: \"kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567\") pod \"console-d7b6d49f5-j6nkl\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") " pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:23.781486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:23.781451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:24.009098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.009016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.064927 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.064887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.240385 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.240351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.416798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.416761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.475118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.475087    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"]
Sep 07 21:03:24.480075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.480051    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.482299 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.482275    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 21:03:24.482514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.482477    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 21:03:24.483204 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.483184    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 21:03:24.483322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.483208    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 21:03:24.483322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.483187    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 21:03:24.483322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.483188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pccdq\""
Sep 07 21:03:24.490637 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.490614    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"]
Sep 07 21:03:24.495202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.495136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.510897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.510874    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4rtxg"]
Sep 07 21:03:24.514463 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.514446    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.516800 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.516746    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 21:03:24.516931 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.516838    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 21:03:24.517096 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.517075    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 21:03:24.517193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.517097    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kr28\""
Sep 07 21:03:24.570746 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-metrics-client-ca\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.570881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.570881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-root\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.570881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-textfile\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.570881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-sys\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.570997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3984b518-53ed-4cae-b62a-59b7707ee4c2-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.571105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.571036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-wtmp\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571300 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.571112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69nkh\" (UniqueName: \"kubernetes.io/projected/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-kube-api-access-69nkh\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571300 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.571134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jgn\" (UniqueName: \"kubernetes.io/projected/3984b518-53ed-4cae-b62a-59b7707ee4c2-kube-api-access-v7jgn\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.571300 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.571152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.571300 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.571167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.629528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.629502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.672234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-metrics-client-ca\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-root\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-textfile\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-sys\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-root\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3984b518-53ed-4cae-b62a-59b7707ee4c2-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:24.672446    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672443    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-sys\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-wtmp\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:24.672499    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls podName:c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e nodeName:}" failed. No retries permitted until 2026-09-07 21:03:25.17248233 +0000 UTC m=+117.008608412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls") pod "node-exporter-4rtxg" (UID: "c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e") : secret "node-exporter-tls" not found
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69nkh\" (UniqueName: \"kubernetes.io/projected/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-kube-api-access-69nkh\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jgn\" (UniqueName: \"kubernetes.io/projected/3984b518-53ed-4cae-b62a-59b7707ee4c2-kube-api-access-v7jgn\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-wtmp\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.672693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.673190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-textfile\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.673190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.672860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-metrics-client-ca\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.673289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.673250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3984b518-53ed-4cae-b62a-59b7707ee4c2-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.673598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.673552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.675668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.675645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.675757 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.675654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3984b518-53ed-4cae-b62a-59b7707ee4c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.675813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.675800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.681658 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.681635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jgn\" (UniqueName: \"kubernetes.io/projected/3984b518-53ed-4cae-b62a-59b7707ee4c2-kube-api-access-v7jgn\") pod \"openshift-state-metrics-657fd6c54-s5ksg\" (UID: \"3984b518-53ed-4cae-b62a-59b7707ee4c2\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.681888 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.681870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69nkh\" (UniqueName: \"kubernetes.io/projected/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-kube-api-access-69nkh\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:24.775641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.775597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:24.790311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.790283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"
Sep 07 21:03:24.876134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:24.876102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.007289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.007199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.106862 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.106823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.176141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.176101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:25.178608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.178581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e-node-exporter-tls\") pod \"node-exporter-4rtxg\" (UID: \"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e\") " pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:25.424547 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.424519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rtxg"
Sep 07 21:03:25.470075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.470031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.560263 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.560213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.561593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.561574    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:03:25.565602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.565579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.568018 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.567994    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 21:03:25.568122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568056    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q7svd\""
Sep 07 21:03:25.568122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568106    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 21:03:25.568234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568125    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 21:03:25.568330 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 21:03:25.568392 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568385    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 21:03:25.568493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568450    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 21:03:25.568493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 21:03:25.568493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568487    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 21:03:25.568697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.568499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 21:03:25.578777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.578879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.578879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhh8v\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.578998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.579524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.579349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:03:25.680090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680349 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:25.680249    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle podName:45177fdf-e3d6-4e0e-99f5-e90be7bd3f81 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:26.180226844 +0000 UTC m=+118.016352943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81") : configmap references non-existent config key: ca-bundle.crt
Sep 07 21:03:25.680349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhh8v\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.680593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.680556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.681271 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.681238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.683428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.683357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.683911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.683631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.683911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.683877    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.684578 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.684344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.684578 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.684409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.684958 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.684876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.685054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.684960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.685236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.685212    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.685335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.685305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.685435 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.685416    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.689037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.689010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhh8v\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:25.767333 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:25.767297    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:25.854479 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:25.854420    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a080d2_1e9e_4e95_a0b4_ec48a9682f5e.slice/crio-b04d42d68637bfac74593e98708af1a3fa2ef73841c2615b1bfd726d8cb160b8 WatchSource:0}: Error finding container b04d42d68637bfac74593e98708af1a3fa2ef73841c2615b1bfd726d8cb160b8: Status 404 returned error can't find the container with id b04d42d68637bfac74593e98708af1a3fa2ef73841c2615b1bfd726d8cb160b8
Sep 07 21:03:26.115298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.115191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg"]
Sep 07 21:03:26.117767 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:26.117739    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3984b518_53ed_4cae_b62a_59b7707ee4c2.slice/crio-8b0cacdec2bd5e391d8b488c1a7801418be9f47d97851606d656ef69ffa702d5 WatchSource:0}: Error finding container 8b0cacdec2bd5e391d8b488c1a7801418be9f47d97851606d656ef69ffa702d5: Status 404 returned error can't find the container with id 8b0cacdec2bd5e391d8b488c1a7801418be9f47d97851606d656ef69ffa702d5
Sep 07 21:03:26.121186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.121156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:03:26.127288 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:26.127250    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1702071_7645_458d_a079_5ccfeaeb5b2a.slice/crio-d2da72daa71781bf4e0c33e590867996541ea8d94d009114e5e2b10e05034492 WatchSource:0}: Error finding container d2da72daa71781bf4e0c33e590867996541ea8d94d009114e5e2b10e05034492: Status 404 returned error can't find the container with id d2da72daa71781bf4e0c33e590867996541ea8d94d009114e5e2b10e05034492
Sep 07 21:03:26.185016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.184991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:26.186090 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.185978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:26.264621 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.264587    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-76lzs" event={"ID":"b8eb7844-e908-4fc0-b5a0-505726caad1b","Type":"ContainerStarted","Data":"a71984cf3516836d754ea85fdb9e756e5bbf627f641f58daf60615cc71727d9c"}
Sep 07 21:03:26.265617 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.265577    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:26.267788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.267725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rtxg" event={"ID":"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e","Type":"ContainerStarted","Data":"b04d42d68637bfac74593e98708af1a3fa2ef73841c2615b1bfd726d8cb160b8"}
Sep 07 21:03:26.270662 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.270636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66549bc4bd-bqfhp" event={"ID":"e075ffd3-ea92-4956-a72a-d75b2394d2d1","Type":"ContainerStarted","Data":"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"}
Sep 07 21:03:26.272713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.272669    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-76lzs"
Sep 07 21:03:26.274367 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.274159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k5vcp" event={"ID":"9a3e92a7-a14d-454c-ae94-7faa7e3182d8","Type":"ContainerStarted","Data":"ce10addf32fae00cb98a1ddfa8f0d827beb27ceb1d5e11594bbd9a30760216da"}
Sep 07 21:03:26.276923 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.276895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg" event={"ID":"3984b518-53ed-4cae-b62a-59b7707ee4c2","Type":"ContainerStarted","Data":"272e5599c0294a0ff6ba9d752cfc30da63e64ad8222aebe2284cd9cb35f65380"}
Sep 07 21:03:26.277047 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.276967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg" event={"ID":"3984b518-53ed-4cae-b62a-59b7707ee4c2","Type":"ContainerStarted","Data":"8b0cacdec2bd5e391d8b488c1a7801418be9f47d97851606d656ef69ffa702d5"}
Sep 07 21:03:26.279761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.279257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b6d49f5-j6nkl" event={"ID":"d1702071-7645-458d-a079-5ccfeaeb5b2a","Type":"ContainerStarted","Data":"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"}
Sep 07 21:03:26.279761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.279295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b6d49f5-j6nkl" event={"ID":"d1702071-7645-458d-a079-5ccfeaeb5b2a","Type":"ContainerStarted","Data":"d2da72daa71781bf4e0c33e590867996541ea8d94d009114e5e2b10e05034492"}
Sep 07 21:03:26.305995 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.304953    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-76lzs" podStartSLOduration=1.414295236 podStartE2EDuration="18.304916605s" totalImagesPullingTime="16.890621369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:26.283355058 +0000 UTC m=+118.119481163" watchObservedRunningTime="2026-09-07 21:03:26.304916605 +0000 UTC m=+118.141042711"
Sep 07 21:03:26.333044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.332716    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k5vcp" podStartSLOduration=33.456194007 podStartE2EDuration="43.332695539s" totalImagesPullingTime="9.876501532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:02:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:26.30633161 +0000 UTC m=+118.142457714" watchObservedRunningTime="2026-09-07 21:03:26.332695539 +0000 UTC m=+118.168821645"
Sep 07 21:03:26.333044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.332856    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66549bc4bd-bqfhp" podStartSLOduration=2.080029994 podStartE2EDuration="12.332847146s" totalImagesPullingTime="10.252817152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:26.330550101 +0000 UTC m=+118.166676217" watchObservedRunningTime="2026-09-07 21:03:26.332847146 +0000 UTC m=+118.168973252"
Sep 07 21:03:26.351592 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.351476    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7b6d49f5-j6nkl" podStartSLOduration=3.351454884 podStartE2EDuration="3.351454884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:26.350169722 +0000 UTC m=+118.186295825" watchObservedRunningTime="2026-09-07 21:03:26.351454884 +0000 UTC m=+118.187580991"
Sep 07 21:03:26.476437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.476140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:03:26.769207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:26.769130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:03:26.772900 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:26.772859    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45177fdf_e3d6_4e0e_99f5_e90be7bd3f81.slice/crio-209bc4c6a1830e8c307bc2e353535258a52e52e0aaca2f21028d0c62f124feb8 WatchSource:0}: Error finding container 209bc4c6a1830e8c307bc2e353535258a52e52e0aaca2f21028d0c62f124feb8: Status 404 returned error can't find the container with id 209bc4c6a1830e8c307bc2e353535258a52e52e0aaca2f21028d0c62f124feb8
Sep 07 21:03:27.286123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.286086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg" event={"ID":"3984b518-53ed-4cae-b62a-59b7707ee4c2","Type":"ContainerStarted","Data":"323c5578c95ca06cabbd75edbee9dacca53a56254b3cbf04b21566173e04e360"}
Sep 07 21:03:27.287581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.287547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"209bc4c6a1830e8c307bc2e353535258a52e52e0aaca2f21028d0c62f124feb8"}
Sep 07 21:03:27.289468 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.289424    2583 generic.go:356] "Generic (PLEG): container finished" podID="c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e" containerID="f2eb10ccf01569b1c08ce3a048852c8e176a526c3cf5ee5a0f2a44c0c512becf" exitCode=0
Sep 07 21:03:27.289586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.289508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rtxg" event={"ID":"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e","Type":"ContainerDied","Data":"f2eb10ccf01569b1c08ce3a048852c8e176a526c3cf5ee5a0f2a44c0c512becf"}
Sep 07 21:03:27.521787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.521651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:27.623638 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.623549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:27.926847 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:27.926788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.145143 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.145012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.244834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.244797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.297342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.297276    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rtxg" event={"ID":"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e","Type":"ContainerStarted","Data":"f6415addeba635a732aa3275764e0b155249b83505d4062e7f0b69f3eacf911f"}
Sep 07 21:03:28.297781 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.297413    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rtxg" event={"ID":"c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e","Type":"ContainerStarted","Data":"79963170efac8ada69462d3da09557c84e5b33b9d4915dda0d1d6e12437c2c92"}
Sep 07 21:03:28.324924 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.324859    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4rtxg" podStartSLOduration=3.2992207000000002 podStartE2EDuration="4.324838475s" totalImagesPullingTime="953.971283ms" totalInitContainerRuntime="71.646492ms" isStatefulPod=true podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:28.323351445 +0000 UTC m=+120.159477549" watchObservedRunningTime="2026-09-07 21:03:28.324838475 +0000 UTC m=+120.160964578"
Sep 07 21:03:28.337335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.337300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.402466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.402368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.503453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:28.503367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:28.897177 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:28.897138    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45177fdf_e3d6_4e0e_99f5_e90be7bd3f81.slice/crio-conmon-7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac.scope\": RecentStats: unable to find data in memory cache]"
Sep 07 21:03:29.184002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.183969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:29.289779 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.287361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:29.297375 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.297311    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"]
Sep 07 21:03:29.306427 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.306398    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac" exitCode=0
Sep 07 21:03:29.313507 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.313484    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:29.313626 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.313529    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"]
Sep 07 21:03:29.313626 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.313552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg" event={"ID":"3984b518-53ed-4cae-b62a-59b7707ee4c2","Type":"ContainerStarted","Data":"9f496879a6a19c306e1a765da2706d0981da4dd941366d471c75df9ee59f9f07"}
Sep 07 21:03:29.313626 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.313589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"}
Sep 07 21:03:29.313761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.313629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.316042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.315797    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 21:03:29.316042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.316036    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4th7t\""
Sep 07 21:03:29.330089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.330045    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-s5ksg" podStartSLOduration=3.196149809 podStartE2EDuration="5.330025794s" totalImagesPullingTime="2.133875985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:29.328338561 +0000 UTC m=+121.164464666" watchObservedRunningTime="2026-09-07 21:03:29.330025794 +0000 UTC m=+121.166151900"
Sep 07 21:03:29.371341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.371310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:29.419267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.419227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/433f69df-2e41-4a62-b616-ad2e06d39611-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.419486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.419352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkv5r\" (UniqueName: \"kubernetes.io/projected/433f69df-2e41-4a62-b616-ad2e06d39611-kube-api-access-zkv5r\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.497655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.497572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:29.520537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.520504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkv5r\" (UniqueName: \"kubernetes.io/projected/433f69df-2e41-4a62-b616-ad2e06d39611-kube-api-access-zkv5r\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.520720 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.520625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/433f69df-2e41-4a62-b616-ad2e06d39611-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.523347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.523319    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/433f69df-2e41-4a62-b616-ad2e06d39611-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.529151 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.529124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkv5r\" (UniqueName: \"kubernetes.io/projected/433f69df-2e41-4a62-b616-ad2e06d39611-kube-api-access-zkv5r\") pod \"monitoring-plugin-85bbbbbf4-c7k46\" (UID: \"433f69df-2e41-4a62-b616-ad2e06d39611\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.597516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.597478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:29.626619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.626587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:29.921691 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:29.921571    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"]
Sep 07 21:03:29.925226 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:29.925199    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433f69df_2e41_4a62_b616_ad2e06d39611.slice/crio-a52d96fbd3fd286e5c3eb4d1d33fac41c33cd677b4a2c925d6e0f891f981c414 WatchSource:0}: Error finding container a52d96fbd3fd286e5c3eb4d1d33fac41c33cd677b4a2c925d6e0f891f981c414: Status 404 returned error can't find the container with id a52d96fbd3fd286e5c3eb4d1d33fac41c33cd677b4a2c925d6e0f891f981c414
Sep 07 21:03:30.314139 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.314041    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46" event={"ID":"433f69df-2e41-4a62-b616-ad2e06d39611","Type":"ContainerStarted","Data":"a52d96fbd3fd286e5c3eb4d1d33fac41c33cd677b4a2c925d6e0f891f981c414"}
Sep 07 21:03:30.345782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.345745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:30.444442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.444401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:30.727118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.726406    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:03:30.823736 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.823576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:30.824813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.824784    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:03:30.854226 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.854152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:03:30.854377 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.854254    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.857576 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.857366    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 21:03:30.857576 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.857391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.858499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.858704    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.858896    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a6rbasg53n30l\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.859152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.859403    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bvzf9\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.859595    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.860338    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.860543    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.860788    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.864066    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 21:03:30.865681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.865233    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 21:03:30.871725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.870350    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 21:03:30.871725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.870967    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 21:03:30.871725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.871232    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 21:03:30.882421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.882205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 21:03:30.916758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.916718    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:30.933962 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.933912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.933981    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934687 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934687 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:30.934890 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:30.934765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4fq6\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.035833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.035897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.035928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.035988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4fq6\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.036678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.037740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.037740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.037740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.036463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.037740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.037143    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.037740 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.037723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.038885 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.038859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.041055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.039878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.043189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.042878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.043189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.042957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.043189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.042977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.043400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.043360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.043561 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.043536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.044103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.044081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.045195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.045169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.047654 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.047614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.050320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.047749    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.050320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.049462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.050320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.049898    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.050320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.050170    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.050320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.050177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.052729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.052686    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.053046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.052895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.055209 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.055186    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4fq6\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6\") pod \"prometheus-k8s-0\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.182707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.182647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:31.456225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.456138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:31.506813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:31.506770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:32.266907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.266783    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:03:32.271510 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:32.271478    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba23a81b_85b1_4dfb_839f_0223014320b6.slice/crio-944d79fb0b8cc357f7b5a69f8a717a234a77485319a41b37c6d1343b17077a8e WatchSource:0}: Error finding container 944d79fb0b8cc357f7b5a69f8a717a234a77485319a41b37c6d1343b17077a8e: Status 404 returned error can't find the container with id 944d79fb0b8cc357f7b5a69f8a717a234a77485319a41b37c6d1343b17077a8e
Sep 07 21:03:32.326466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.326436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"}
Sep 07 21:03:32.326560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.326520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"}
Sep 07 21:03:32.328059 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.328033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"944d79fb0b8cc357f7b5a69f8a717a234a77485319a41b37c6d1343b17077a8e"}
Sep 07 21:03:32.329751 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.329719    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46" event={"ID":"433f69df-2e41-4a62-b616-ad2e06d39611","Type":"ContainerStarted","Data":"8e12260388a62436f790cb3cacf1247d6f9e29cae2c978ad5eb1c8700336ed73"}
Sep 07 21:03:32.334106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.333832    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:32.340336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.340289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46"
Sep 07 21:03:32.353788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.353741    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c7k46" podStartSLOduration=1.301012623 podStartE2EDuration="3.353720697s" totalImagesPullingTime="2.052708074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:32.352766271 +0000 UTC m=+124.188892374" watchObservedRunningTime="2026-09-07 21:03:32.353720697 +0000 UTC m=+124.189847107"
Sep 07 21:03:32.510859 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:32.510827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:33.122178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.122141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:33.223447 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.223415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:33.338699 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.338666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"}
Sep 07 21:03:33.338868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.338753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"}
Sep 07 21:03:33.338868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.338795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"}
Sep 07 21:03:33.340530 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.340500    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e" exitCode=0
Sep 07 21:03:33.340686 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.340589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"}
Sep 07 21:03:33.782043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.781977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:33.782470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.782107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:33.787346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:33.787323    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:34.352067 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:34.351121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerStarted","Data":"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"}
Sep 07 21:03:34.357326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:34.357266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:03:34.385501 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:34.385441    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.384623996 podStartE2EDuration="9.38542317s" totalImagesPullingTime="5.986504781s" totalInitContainerRuntime="14.294393ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:34.383260762 +0000 UTC m=+126.219386865" watchObservedRunningTime="2026-09-07 21:03:34.38542317 +0000 UTC m=+126.221549274"
Sep 07 21:03:34.711673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:34.711635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:34.812331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:34.812213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:35.283418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:35.283382    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:37.367134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:37.367101    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"}
Sep 07 21:03:37.367490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:37.367175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"}
Sep 07 21:03:38.406759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:38.406724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:03:38.409287 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:38.409264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7700639-a809-449f-b7d6-38b6d2872fc7-metrics-certs\") pod \"network-metrics-daemon-8xdwm\" (UID: \"b7700639-a809-449f-b7d6-38b6d2872fc7\") " pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:03:38.489692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:38.489662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9r8wd\""
Sep 07 21:03:38.497484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:38.497458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xdwm"
Sep 07 21:03:39.090725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:39.090695    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xdwm"]
Sep 07 21:03:39.182765 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:03:39.182735    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7700639_a809_449f_b7d6_38b6d2872fc7.slice/crio-e3314cd69a7cf56c1bcbe956c576f61e7634601866d7e45d9211dff90104074e WatchSource:0}: Error finding container e3314cd69a7cf56c1bcbe956c576f61e7634601866d7e45d9211dff90104074e: Status 404 returned error can't find the container with id e3314cd69a7cf56c1bcbe956c576f61e7634601866d7e45d9211dff90104074e
Sep 07 21:03:39.376616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:39.376585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xdwm" event={"ID":"b7700639-a809-449f-b7d6-38b6d2872fc7","Type":"ContainerStarted","Data":"e3314cd69a7cf56c1bcbe956c576f61e7634601866d7e45d9211dff90104074e"}
Sep 07 21:03:39.379366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:39.379340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"}
Sep 07 21:03:39.921291 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:39.921250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:39.922292 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:39.922265    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:03:40.018095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.018057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:40.069190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.069151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:40.333717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.333637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:40.388278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.388248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"}
Sep 07 21:03:40.388416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.388312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"}
Sep 07 21:03:40.388416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.388339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerStarted","Data":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"}
Sep 07 21:03:40.417873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.417809    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.770713522 podStartE2EDuration="10.417787859s" totalImagesPullingTime="5.622985615s" totalInitContainerRuntime="24.088722ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:40.416539125 +0000 UTC m=+132.252665254" watchObservedRunningTime="2026-09-07 21:03:40.417787859 +0000 UTC m=+132.253913966"
Sep 07 21:03:40.420918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:40.420884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:41.183003 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.182972    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:03:41.394347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.394278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xdwm" event={"ID":"b7700639-a809-449f-b7d6-38b6d2872fc7","Type":"ContainerStarted","Data":"90ea50910931a27e6cd18c5ee5b40a9d219a6ae2abd8b971f68a97ef1b616052"}
Sep 07 21:03:41.394347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.394329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xdwm" event={"ID":"b7700639-a809-449f-b7d6-38b6d2872fc7","Type":"ContainerStarted","Data":"9e44ed2d7284ecae8e5107dbffcb7e975ee1c575f758e6e988764a2b4c2ae569"}
Sep 07 21:03:41.411598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.411553    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8xdwm" podStartSLOduration=130.93805281 podStartE2EDuration="2m12.411537829s" totalImagesPullingTime="1.473485019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:41.409563916 +0000 UTC m=+133.245690019" watchObservedRunningTime="2026-09-07 21:03:41.411537829 +0000 UTC m=+133.247663933"
Sep 07 21:03:41.498728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.498699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:41.599820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:41.599786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:44.871424 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:44.871384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:45.344060 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:45.344019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:45.403055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:45.403025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:52.599074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:52.599024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:52.700956 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:52.700903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:52.800030 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:52.799995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:53.444680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:53.444652    2583 generic.go:356] "Generic (PLEG): container finished" podID="a35adee1-d31e-4c91-827c-ac35c96d542d" containerID="9bc6af421df764c3ef3677f4ef70c7983a4581e2ba55e5a936990973e5976749" exitCode=0
Sep 07 21:03:53.444822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:53.444730    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf" event={"ID":"a35adee1-d31e-4c91-827c-ac35c96d542d","Type":"ContainerDied","Data":"9bc6af421df764c3ef3677f4ef70c7983a4581e2ba55e5a936990973e5976749"}
Sep 07 21:03:53.445052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:53.445039    2583 scope.go:117] "RemoveContainer" containerID="9bc6af421df764c3ef3677f4ef70c7983a4581e2ba55e5a936990973e5976749"
Sep 07 21:03:54.338660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.338618    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66549bc4bd-bqfhp" podUID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" containerName="console" containerID="cri-o://8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd" gracePeriod=15
Sep 07 21:03:54.451540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.451506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-plvwf" event={"ID":"a35adee1-d31e-4c91-827c-ac35c96d542d","Type":"ContainerStarted","Data":"3166fde32d9db173e94ccd21087829cd4e09887c7ac131b654d7130f0edd139a"}
Sep 07 21:03:54.594285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.594231    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:54.747750 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747717    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.747895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747763    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.747895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747782    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.747895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747807    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz97k\" (UniqueName: \"kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.747895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.747895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.747872    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert\") pod \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\" (UID: \"e075ffd3-ea92-4956-a72a-d75b2394d2d1\") "
Sep 07 21:03:54.748232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.748201    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:54.748291 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.748246    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config" (OuterVolumeSpecName: "console-config") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:54.748338 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.748293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:54.750027 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.750003    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:54.750126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.750031    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k" (OuterVolumeSpecName: "kube-api-access-dz97k") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "kube-api-access-dz97k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:54.750126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.750051    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e075ffd3-ea92-4956-a72a-d75b2394d2d1" (UID: "e075ffd3-ea92-4956-a72a-d75b2394d2d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849306    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-oauth-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849328    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-oauth-serving-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849337    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849346    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e075ffd3-ea92-4956-a72a-d75b2394d2d1-console-serving-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849354    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e075ffd3-ea92-4956-a72a-d75b2394d2d1-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:54.849368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:54.849362    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz97k\" (UniqueName: \"kubernetes.io/projected/e075ffd3-ea92-4956-a72a-d75b2394d2d1-kube-api-access-dz97k\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:55.456905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.456872    2583 generic.go:356] "Generic (PLEG): container finished" podID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" containerID="8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd" exitCode=0
Sep 07 21:03:55.457363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.456926    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66549bc4bd-bqfhp"
Sep 07 21:03:55.457363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.456971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66549bc4bd-bqfhp" event={"ID":"e075ffd3-ea92-4956-a72a-d75b2394d2d1","Type":"ContainerDied","Data":"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"}
Sep 07 21:03:55.457363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.457065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66549bc4bd-bqfhp" event={"ID":"e075ffd3-ea92-4956-a72a-d75b2394d2d1","Type":"ContainerDied","Data":"b0feaed439721307557da68e0126101e1a06f4252bc1da7883ef62302b7a2b81"}
Sep 07 21:03:55.457363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.457096    2583 scope.go:117] "RemoveContainer" containerID="8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"
Sep 07 21:03:55.469697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.469680    2583 scope.go:117] "RemoveContainer" containerID="8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"
Sep 07 21:03:55.470003 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:55.469969    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd\": container with ID starting with 8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd not found: ID does not exist" containerID="8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"
Sep 07 21:03:55.470105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.470008    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd"} err="failed to get container status \"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd\": rpc error: code = NotFound desc = could not find container \"8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd\": container with ID starting with 8b40722bf715c23c1a7e5a79ec561971af35d2c304bb004bb9fe3ce2d68712cd not found: ID does not exist"
Sep 07 21:03:55.479101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.479080    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:55.481347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.481327    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66549bc4bd-bqfhp"]
Sep 07 21:03:55.753070 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.752980    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" podUID="58748c75-51de-48fc-8679-6a1fc5c4c571" containerName="registry" containerID="cri-o://858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3" gracePeriod=30
Sep 07 21:03:55.972816 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.972777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:55.983108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:55.983083    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:56.073404 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.073303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:56.124650 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.124611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:03:56.158568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158534    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.158568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.158774 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158607    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.158831 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158807    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.158884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158867    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr58w\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.158964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.159017 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.158995    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.159075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.159029    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted\") pod \"58748c75-51de-48fc-8679-6a1fc5c4c571\" (UID: \"58748c75-51de-48fc-8679-6a1fc5c4c571\") "
Sep 07 21:03:56.159195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.159138    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:56.159261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.159240    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:56.159379 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.159331    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-certificates\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.159493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.159475    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58748c75-51de-48fc-8679-6a1fc5c4c571-trusted-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.161208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.161179    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:56.161331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.161287    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:56.161422 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.161385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:56.161422 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.161392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w" (OuterVolumeSpecName: "kube-api-access-wr58w") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "kube-api-access-wr58w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:56.161542 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.161472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:56.167108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.167086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58748c75-51de-48fc-8679-6a1fc5c4c571" (UID: "58748c75-51de-48fc-8679-6a1fc5c4c571"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:03:56.260158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260118    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-image-registry-private-configuration\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.260158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260151    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58748c75-51de-48fc-8679-6a1fc5c4c571-ca-trust-extracted\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.260158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260161    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-bound-sa-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.260372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260170    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58748c75-51de-48fc-8679-6a1fc5c4c571-installation-pull-secrets\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.260372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260180    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr58w\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-kube-api-access-wr58w\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.260372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.260189    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58748c75-51de-48fc-8679-6a1fc5c4c571-registry-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:03:56.463896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.463860    2583 generic.go:356] "Generic (PLEG): container finished" podID="58748c75-51de-48fc-8679-6a1fc5c4c571" containerID="858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3" exitCode=0
Sep 07 21:03:56.464307 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.463903    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb"
Sep 07 21:03:56.464307 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.463963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" event={"ID":"58748c75-51de-48fc-8679-6a1fc5c4c571","Type":"ContainerDied","Data":"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"}
Sep 07 21:03:56.464307 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.464038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c9c58c794-9gsfb" event={"ID":"58748c75-51de-48fc-8679-6a1fc5c4c571","Type":"ContainerDied","Data":"6efc99c217ea45d549c7a94e8efe160b4a085365d44cfa84b0bd730d6e9f254e"}
Sep 07 21:03:56.464307 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.464061    2583 scope.go:117] "RemoveContainer" containerID="858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"
Sep 07 21:03:56.472122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.472104    2583 scope.go:117] "RemoveContainer" containerID="858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"
Sep 07 21:03:56.472375 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:03:56.472357    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3\": container with ID starting with 858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3 not found: ID does not exist" containerID="858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"
Sep 07 21:03:56.472429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.472382    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3"} err="failed to get container status \"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3\": rpc error: code = NotFound desc = could not find container \"858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3\": container with ID starting with 858a8e70e4aef11d8a7df4ff93f0fbbe3803d74bdfe5c5c077f1f8432efb91c3 not found: ID does not exist"
Sep 07 21:03:56.483545 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.483527    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:03:56.487232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.487212    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c9c58c794-9gsfb"]
Sep 07 21:03:56.675641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.675601    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58748c75-51de-48fc-8679-6a1fc5c4c571" path="/var/lib/kubelet/pods/58748c75-51de-48fc-8679-6a1fc5c4c571/volumes"
Sep 07 21:03:56.676046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:03:56.676031    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" path="/var/lib/kubelet/pods/e075ffd3-ea92-4956-a72a-d75b2394d2d1/volumes"
Sep 07 21:04:00.101996 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:00.101928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:00.160674 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:00.160617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:00.345770 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:00.345729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:00.440224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:00.440181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:04.949195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:04.949155    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d7b6d49f5-j6nkl" podUID="d1702071-7645-458d-a079-5ccfeaeb5b2a" containerName="console" containerID="cri-o://9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f" gracePeriod=15
Sep 07 21:04:05.229126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.229038    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:04:05.331196 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331223    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331242    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331268    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331287    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6567\" (UniqueName: \"kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config\") pod \"d1702071-7645-458d-a079-5ccfeaeb5b2a\" (UID: \"d1702071-7645-458d-a079-5ccfeaeb5b2a\") "
Sep 07 21:04:05.331693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331602    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:05.331801 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331768    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:05.331882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331808    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:05.331882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.331842    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config" (OuterVolumeSpecName: "console-config") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:05.333444 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.333418    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:05.333523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.333461    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567" (OuterVolumeSpecName: "kube-api-access-j6567") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "kube-api-access-j6567". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:04:05.333558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.333522    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1702071-7645-458d-a079-5ccfeaeb5b2a" (UID: "d1702071-7645-458d-a079-5ccfeaeb5b2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:05.432277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432239    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-oauth-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432276    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432293    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-serving-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432306    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-trusted-ca-bundle\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432319    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6567\" (UniqueName: \"kubernetes.io/projected/d1702071-7645-458d-a079-5ccfeaeb5b2a-kube-api-access-j6567\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432332    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-console-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.432473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.432344    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1702071-7645-458d-a079-5ccfeaeb5b2a-oauth-serving-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:05.502405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.502317    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1702071-7645-458d-a079-5ccfeaeb5b2a" containerID="9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f" exitCode=0
Sep 07 21:04:05.502405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.502371    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7b6d49f5-j6nkl"
Sep 07 21:04:05.502405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.502387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b6d49f5-j6nkl" event={"ID":"d1702071-7645-458d-a079-5ccfeaeb5b2a","Type":"ContainerDied","Data":"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"}
Sep 07 21:04:05.502653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.502427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7b6d49f5-j6nkl" event={"ID":"d1702071-7645-458d-a079-5ccfeaeb5b2a","Type":"ContainerDied","Data":"d2da72daa71781bf4e0c33e590867996541ea8d94d009114e5e2b10e05034492"}
Sep 07 21:04:05.502653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.502447    2583 scope.go:117] "RemoveContainer" containerID="9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"
Sep 07 21:04:05.510527 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.510509    2583 scope.go:117] "RemoveContainer" containerID="9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"
Sep 07 21:04:05.510751 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:05.510730    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f\": container with ID starting with 9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f not found: ID does not exist" containerID="9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"
Sep 07 21:04:05.510792 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.510755    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f"} err="failed to get container status \"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f\": rpc error: code = NotFound desc = could not find container \"9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f\": container with ID starting with 9a50a54dae901a1070c2afe6629428f7aeac242a3e16188106729741df4b798f not found: ID does not exist"
Sep 07 21:04:05.521757 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.521738    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:04:05.526083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:05.526054    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d7b6d49f5-j6nkl"]
Sep 07 21:04:06.675566 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:06.675523    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1702071-7645-458d-a079-5ccfeaeb5b2a" path="/var/lib/kubelet/pods/d1702071-7645-458d-a079-5ccfeaeb5b2a/volumes"
Sep 07 21:04:31.183818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:31.183757    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:31.202049 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:31.202023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:31.621387 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:31.621321    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:37.992750 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:37.992715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:38.092857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:38.092822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:40.797243 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:40.797203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:43.811268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:43.811232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:44.112996 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.112901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:44.864783 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.864748    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:44.865219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865082    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="alertmanager" containerID="cri-o://bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087" gracePeriod=120
Sep 07 21:04:44.865219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865136    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-metric" containerID="cri-o://809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47" gracePeriod=120
Sep 07 21:04:44.865219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865163    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-web" containerID="cri-o://68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7" gracePeriod=120
Sep 07 21:04:44.865219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865187    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy" containerID="cri-o://232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9" gracePeriod=120
Sep 07 21:04:44.865470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865169    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="config-reloader" containerID="cri-o://fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898" gracePeriod=120
Sep 07 21:04:44.865470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:44.865247    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="prom-label-proxy" containerID="cri-o://dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f" gracePeriod=120
Sep 07 21:04:45.659573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659541    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f" exitCode=0
Sep 07 21:04:45.659573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659563    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9" exitCode=0
Sep 07 21:04:45.659573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659569    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898" exitCode=0
Sep 07 21:04:45.659573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659576    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087" exitCode=0
Sep 07 21:04:45.659879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"}
Sep 07 21:04:45.659879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"}
Sep 07 21:04:45.659879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"}
Sep 07 21:04:45.659879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:45.659777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"}
Sep 07 21:04:46.206392 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.206338    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.282694 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.282668    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.282848 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.282719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.282848 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.282746    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.282959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.282925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283009    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283081 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283081 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283074    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283095    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:46.283189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283195    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283234    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhh8v\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v\") pod \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\" (UID: \"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81\") "
Sep 07 21:04:46.283538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283520    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-metrics-client-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.283620 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.283584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:04:46.284094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.284042    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:46.286425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.286292    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.286656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.286624    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.287024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.286933    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:04:46.287221 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.287191    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v" (OuterVolumeSpecName: "kube-api-access-mhh8v") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "kube-api-access-mhh8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:04:46.287428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.287400    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.287504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.287400    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out" (OuterVolumeSpecName: "config-out") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:04:46.287633 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.287611    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume" (OuterVolumeSpecName: "config-volume") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.287893 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.287874    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.291581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.291549    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.297031 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.297012    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config" (OuterVolumeSpecName: "web-config") pod "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" (UID: "45177fdf-e3d6-4e0e-99f5-e90be7bd3f81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:46.384544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384520    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-main-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384542    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-main-db\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384553    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384563    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-out\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384572    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384582    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384591    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-cluster-tls-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384600    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384608    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhh8v\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-kube-api-access-mhh8v\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384616    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-tls-assets\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384623    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.384682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.384632    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81-web-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:46.666368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666340    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47" exitCode=0
Sep 07 21:04:46.666368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666363    2583 generic.go:356] "Generic (PLEG): container finished" podID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerID="68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7" exitCode=0
Sep 07 21:04:46.666618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666433    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.666618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"}
Sep 07 21:04:46.666618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"}
Sep 07 21:04:46.666618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45177fdf-e3d6-4e0e-99f5-e90be7bd3f81","Type":"ContainerDied","Data":"209bc4c6a1830e8c307bc2e353535258a52e52e0aaca2f21028d0c62f124feb8"}
Sep 07 21:04:46.666823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.666645    2583 scope.go:117] "RemoveContainer" containerID="dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"
Sep 07 21:04:46.675082 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.674958    2583 scope.go:117] "RemoveContainer" containerID="809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"
Sep 07 21:04:46.681798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.681782    2583 scope.go:117] "RemoveContainer" containerID="232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"
Sep 07 21:04:46.688870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.688852    2583 scope.go:117] "RemoveContainer" containerID="68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"
Sep 07 21:04:46.689481 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.689460    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:46.694191 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.694171    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:46.696140 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.696124    2583 scope.go:117] "RemoveContainer" containerID="fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"
Sep 07 21:04:46.702495 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.702480    2583 scope.go:117] "RemoveContainer" containerID="bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"
Sep 07 21:04:46.709402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.709381    2583 scope.go:117] "RemoveContainer" containerID="7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"
Sep 07 21:04:46.716327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716305    2583 scope.go:117] "RemoveContainer" containerID="dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"
Sep 07 21:04:46.716453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716330    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:46.716575 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.716557    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f\": container with ID starting with dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f not found: ID does not exist" containerID="dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"
Sep 07 21:04:46.716638 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716580    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"} err="failed to get container status \"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f\": rpc error: code = NotFound desc = could not find container \"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f\": container with ID starting with dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f not found: ID does not exist"
Sep 07 21:04:46.716638 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716598    2583 scope.go:117] "RemoveContainer" containerID="809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"
Sep 07 21:04:46.716744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716684    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="init-config-reloader"
Sep 07 21:04:46.716744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716701    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="init-config-reloader"
Sep 07 21:04:46.716744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716717    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-metric"
Sep 07 21:04:46.716744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716726    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-metric"
Sep 07 21:04:46.716744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716738    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1702071-7645-458d-a079-5ccfeaeb5b2a" containerName="console"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716749    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1702071-7645-458d-a079-5ccfeaeb5b2a" containerName="console"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716763    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716772    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716787    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="alertmanager"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716797    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="alertmanager"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716810    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-web"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.716811    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47\": container with ID starting with 809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47 not found: ID does not exist" containerID="809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716820    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-web"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716832    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58748c75-51de-48fc-8679-6a1fc5c4c571" containerName="registry"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716829    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"} err="failed to get container status \"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47\": rpc error: code = NotFound desc = could not find container \"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47\": container with ID starting with 809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47 not found: ID does not exist"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716841    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58748c75-51de-48fc-8679-6a1fc5c4c571" containerName="registry"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716845    2583 scope.go:117] "RemoveContainer" containerID="232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716854    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="config-reloader"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716863    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="config-reloader"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716880    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="prom-label-proxy"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716888    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="prom-label-proxy"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716899    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" containerName="console"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716907    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" containerName="console"
Sep 07 21:04:46.716984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.716989    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="config-reloader"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717002    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e075ffd3-ea92-4956-a72a-d75b2394d2d1" containerName="console"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717009    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1702071-7645-458d-a079-5ccfeaeb5b2a" containerName="console"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717017    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717025    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58748c75-51de-48fc-8679-6a1fc5c4c571" containerName="registry"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717034    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="prom-label-proxy"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717041    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-metric"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717050    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="alertmanager"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717057    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" containerName="kube-rbac-proxy-web"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.717076    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9\": container with ID starting with 232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9 not found: ID does not exist" containerID="232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717091    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"} err="failed to get container status \"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9\": rpc error: code = NotFound desc = could not find container \"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9\": container with ID starting with 232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9 not found: ID does not exist"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717103    2583 scope.go:117] "RemoveContainer" containerID="68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.717300    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7\": container with ID starting with 68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7 not found: ID does not exist" containerID="68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717314    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"} err="failed to get container status \"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7\": rpc error: code = NotFound desc = could not find container \"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7\": container with ID starting with 68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7 not found: ID does not exist"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717325    2583 scope.go:117] "RemoveContainer" containerID="fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.717511    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898\": container with ID starting with fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898 not found: ID does not exist" containerID="fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717526    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"} err="failed to get container status \"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898\": rpc error: code = NotFound desc = could not find container \"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898\": container with ID starting with fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898 not found: ID does not exist"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717536    2583 scope.go:117] "RemoveContainer" containerID="bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.717720    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087\": container with ID starting with bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087 not found: ID does not exist" containerID="bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717735    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"} err="failed to get container status \"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087\": rpc error: code = NotFound desc = could not find container \"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087\": container with ID starting with bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087 not found: ID does not exist"
Sep 07 21:04:46.717896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717748    2583 scope.go:117] "RemoveContainer" containerID="7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:46.717954    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac\": container with ID starting with 7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac not found: ID does not exist" containerID="7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717972    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"} err="failed to get container status \"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac\": rpc error: code = NotFound desc = could not find container \"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac\": container with ID starting with 7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac not found: ID does not exist"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.717984    2583 scope.go:117] "RemoveContainer" containerID="dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718189    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f"} err="failed to get container status \"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f\": rpc error: code = NotFound desc = could not find container \"dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f\": container with ID starting with dc7608bbc2163a606d12dbbd9e66393db66a68e5257f8e88c98796aec1c23a4f not found: ID does not exist"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718208    2583 scope.go:117] "RemoveContainer" containerID="809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718395    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47"} err="failed to get container status \"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47\": rpc error: code = NotFound desc = could not find container \"809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47\": container with ID starting with 809903825ed191d24502a98b0e40b955a6a4cef1e3d13a9cc01a2d4ea93b6c47 not found: ID does not exist"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718410    2583 scope.go:117] "RemoveContainer" containerID="232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718585    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9"} err="failed to get container status \"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9\": rpc error: code = NotFound desc = could not find container \"232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9\": container with ID starting with 232fcc5fdf1bf5b27fee128236a0faefd604889f543572b37283beb5c18553d9 not found: ID does not exist"
Sep 07 21:04:46.718763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718601    2583 scope.go:117] "RemoveContainer" containerID="68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"
Sep 07 21:04:46.719055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718786    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7"} err="failed to get container status \"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7\": rpc error: code = NotFound desc = could not find container \"68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7\": container with ID starting with 68bd47e39b73b387835da6e385cc04dc37ddc3c3b893bc588e2ac3b867028ad7 not found: ID does not exist"
Sep 07 21:04:46.719055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.718799    2583 scope.go:117] "RemoveContainer" containerID="fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"
Sep 07 21:04:46.719055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.719019    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898"} err="failed to get container status \"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898\": rpc error: code = NotFound desc = could not find container \"fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898\": container with ID starting with fb3ae636a4204cc0ddf1c969d4e44a346c27fdfcb426d42b35aac529024b7898 not found: ID does not exist"
Sep 07 21:04:46.719055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.719034    2583 scope.go:117] "RemoveContainer" containerID="bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"
Sep 07 21:04:46.719244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.719227    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087"} err="failed to get container status \"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087\": rpc error: code = NotFound desc = could not find container \"bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087\": container with ID starting with bdd2fc5ae8f5b6d7ebdef610a36032fb52f668e9a10a46f3fb718abb14b78087 not found: ID does not exist"
Sep 07 21:04:46.719281 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.719244    2583 scope.go:117] "RemoveContainer" containerID="7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"
Sep 07 21:04:46.719462 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.719447    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac"} err="failed to get container status \"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac\": rpc error: code = NotFound desc = could not find container \"7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac\": container with ID starting with 7195d4b12c2aec14869db0484044b24b55e2e6b62221c17aabac39fcfc33eaac not found: ID does not exist"
Sep 07 21:04:46.720602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.720585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.723102 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723084    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 21:04:46.723199 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q7svd\""
Sep 07 21:04:46.723199 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723187    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 21:04:46.723308 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 21:04:46.723363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723307    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 21:04:46.723540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 21:04:46.723597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723554    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 21:04:46.723645 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723558    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 21:04:46.723855 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.723841    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 21:04:46.729843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.729822    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 21:04:46.733962 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.733926    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:46.888377 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888377 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-out\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2p2\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-kube-api-access-9s2p2\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-web-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.888891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.888773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989183    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-out\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2p2\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-kube-api-access-9s2p2\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-web-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.989696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.989615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.990115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.990077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.991433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.991378    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4e83404-85c7-4102-ac8d-bef7efcfb661-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.992354 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.992331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.992464 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.992319    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-web-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.992553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.992533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-out\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.992732 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.992710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.992807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.992792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.993187 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.993167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-config-volume\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.993407 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.993390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.993457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.993430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.993823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.993801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e4e83404-85c7-4102-ac8d-bef7efcfb661-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:46.998731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:46.998710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2p2\" (UniqueName: \"kubernetes.io/projected/e4e83404-85c7-4102-ac8d-bef7efcfb661-kube-api-access-9s2p2\") pod \"alertmanager-main-0\" (UID: \"e4e83404-85c7-4102-ac8d-bef7efcfb661\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:47.031735 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:47.031698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 21:04:47.309434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:47.309406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 21:04:47.311867 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:04:47.311841    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e83404_85c7_4102_ac8d_bef7efcfb661.slice/crio-c238e3596d6e39ec5e4ae59609dc7114642376f4dca2cbc3acf24cea1fb137cf WatchSource:0}: Error finding container c238e3596d6e39ec5e4ae59609dc7114642376f4dca2cbc3acf24cea1fb137cf: Status 404 returned error can't find the container with id c238e3596d6e39ec5e4ae59609dc7114642376f4dca2cbc3acf24cea1fb137cf
Sep 07 21:04:47.676220 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:47.676184    2583 generic.go:356] "Generic (PLEG): container finished" podID="e4e83404-85c7-4102-ac8d-bef7efcfb661" containerID="07dd113a0f2dcb0ad1d75b6632db5457c88bfabefb39013c5d717f208cfc8559" exitCode=0
Sep 07 21:04:47.676400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:47.676264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerDied","Data":"07dd113a0f2dcb0ad1d75b6632db5457c88bfabefb39013c5d717f208cfc8559"}
Sep 07 21:04:47.676400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:47.676367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"c238e3596d6e39ec5e4ae59609dc7114642376f4dca2cbc3acf24cea1fb137cf"}
Sep 07 21:04:48.676139 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.676107    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45177fdf-e3d6-4e0e-99f5-e90be7bd3f81" path="/var/lib/kubelet/pods/45177fdf-e3d6-4e0e-99f5-e90be7bd3f81/volumes"
Sep 07 21:04:48.683851 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.683822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"7fd49855cc2032a5de3f10d460fae93c28b13aef0594f5be4c00b8e0c4486301"}
Sep 07 21:04:48.684033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.683897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"21c44f4b84e52848a9a80c13d1ee3979be4e313b8827da4198104e8a36078821"}
Sep 07 21:04:48.684033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.683955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"54eecbbb6f4cb74abc1db69a08ad8599c01d86672c73e02c48b84250fdb6f019"}
Sep 07 21:04:48.684033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.683991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"8ea6c205e62b533dc3326e2ecbf83d26a6bd1f378d1edcbb89f24f407756c81d"}
Sep 07 21:04:48.684033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.684020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"2b462b434ac55edca6e57eae297b4ce967e4c39aa1cc7f452cc5235764da5b9e"}
Sep 07 21:04:48.684195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.684042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e4e83404-85c7-4102-ac8d-bef7efcfb661","Type":"ContainerStarted","Data":"a33c0eb6b608e8b87c73dce948f44615605f3f41967edbcff82d993058cc5e9a"}
Sep 07 21:04:48.710004 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.709874    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.696881494 podStartE2EDuration="2.709852714s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.97122ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:48.70791017 +0000 UTC m=+200.544036277" watchObservedRunningTime="2026-09-07 21:04:48.709852714 +0000 UTC m=+200.545978837"
Sep 07 21:04:48.883713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.883683    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68f8f67cd-87jd9"]
Sep 07 21:04:48.889492 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.887400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:48.890270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890249    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vnzrd\""
Sep 07 21:04:48.890382 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890362    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 07 21:04:48.890470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890456    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 07 21:04:48.890515 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890472    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 07 21:04:48.890608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890593    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 07 21:04:48.890678 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.890664    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 07 21:04:48.896578 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.896557    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 07 21:04:48.900732 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:48.900713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68f8f67cd-87jd9"]
Sep 07 21:04:49.007327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-serving-certs-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl2mj\" (UniqueName: \"kubernetes.io/projected/90b9ced7-cdfb-4739-adcf-7c527a932863-kube-api-access-sl2mj\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-metrics-client-ca\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-federate-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.007644 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.007525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-serving-certs-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2mj\" (UniqueName: \"kubernetes.io/projected/90b9ced7-cdfb-4739-adcf-7c527a932863-kube-api-access-sl2mj\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-metrics-client-ca\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-federate-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108801 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.108963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.108923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-serving-certs-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.109221 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.109191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.109341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.109242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b9ced7-cdfb-4739-adcf-7c527a932863-metrics-client-ca\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.110856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.110826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-telemeter-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.111013 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.110985    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-federate-client-tls\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.111277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.111262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.111360 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.111343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90b9ced7-cdfb-4739-adcf-7c527a932863-secret-telemeter-client\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.115437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.115413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl2mj\" (UniqueName: \"kubernetes.io/projected/90b9ced7-cdfb-4739-adcf-7c527a932863-kube-api-access-sl2mj\") pod \"telemeter-client-68f8f67cd-87jd9\" (UID: \"90b9ced7-cdfb-4739-adcf-7c527a932863\") " pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.177765 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.177735    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:49.178078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178044    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="thanos-sidecar" containerID="cri-o://4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6" gracePeriod=600
Sep 07 21:04:49.178078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178040    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="prometheus" containerID="cri-o://1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4" gracePeriod=600
Sep 07 21:04:49.178247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178048    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy" containerID="cri-o://816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a" gracePeriod=600
Sep 07 21:04:49.178247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178100    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84" gracePeriod=600
Sep 07 21:04:49.178247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178088    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-web" containerID="cri-o://e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8" gracePeriod=600
Sep 07 21:04:49.178247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.178098    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="config-reloader" containerID="cri-o://9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4" gracePeriod=600
Sep 07 21:04:49.198653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.198631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9"
Sep 07 21:04:49.409838 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.409813    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.474822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.474792    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68f8f67cd-87jd9"]
Sep 07 21:04:49.476678 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:04:49.476652    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b9ced7_cdfb_4739_adcf_7c527a932863.slice/crio-6a25bb2902c24714111ecdf71acf4ba839bd362ecdd7e3c7a204ce277ad53520 WatchSource:0}: Error finding container 6a25bb2902c24714111ecdf71acf4ba839bd362ecdd7e3c7a204ce277ad53520: Status 404 returned error can't find the container with id 6a25bb2902c24714111ecdf71acf4ba839bd362ecdd7e3c7a204ce277ad53520
Sep 07 21:04:49.512809 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.512789    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.512917 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.512815    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.512917 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.512844    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.512917 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.512863    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.512917 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.512884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513001    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513041    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513256    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513387    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513448    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4fq6\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513519    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.513683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513674    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513708    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513732    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513758    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513786    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.513813    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle\") pod \"ba23a81b-85b1-4dfb-839f-0223014320b6\" (UID: \"ba23a81b-85b1-4dfb-839f-0223014320b6\") "
Sep 07 21:04:49.514264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.514086    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.514575 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.514392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.514926 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.514851    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:04:49.514926 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.514883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.515213 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.515189    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.515612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.515584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.515731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.515701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.516240 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.516202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:04:49.517064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.516994    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517280 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517069    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517294    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6" (OuterVolumeSpecName: "kube-api-access-t4fq6") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "kube-api-access-t4fq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:04:49.517514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517485    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517495    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517792 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.517883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.517792    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out" (OuterVolumeSpecName: "config-out") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:04:49.518563 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.518536    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:04:49.518563 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.518552    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config" (OuterVolumeSpecName: "config") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.518839 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.518811    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.526453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.526434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config" (OuterVolumeSpecName: "web-config") pod "ba23a81b-85b1-4dfb-839f-0223014320b6" (UID: "ba23a81b-85b1-4dfb-839f-0223014320b6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:04:49.614581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614530    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-db\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614549    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614558    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-tls-assets\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614567    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-metrics-client-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614575    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4fq6\" (UniqueName: \"kubernetes.io/projected/ba23a81b-85b1-4dfb-839f-0223014320b6-kube-api-access-t4fq6\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614583    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-metrics-client-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614592    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba23a81b-85b1-4dfb-839f-0223014320b6-config-out\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614600    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614608    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614618    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614627    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614638    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614646    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba23a81b-85b1-4dfb-839f-0223014320b6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614655    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-kube-rbac-proxy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614662    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-grpc-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614670    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614678    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-web-config\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614685    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.614772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.614693    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba23a81b-85b1-4dfb-839f-0223014320b6-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:04:49.691006 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.690977    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84" exitCode=0
Sep 07 21:04:49.691006 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691001    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a" exitCode=0
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691009    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8" exitCode=0
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691017    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6" exitCode=0
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691023    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4" exitCode=0
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691029    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4" exitCode=0
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691044    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691064    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"}
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"}
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691180    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"}
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691216    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691219    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"}
Sep 07 21:04:49.691329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"}
Sep 07 21:04:49.691801 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"}
Sep 07 21:04:49.691801 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.691395    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba23a81b-85b1-4dfb-839f-0223014320b6","Type":"ContainerDied","Data":"944d79fb0b8cc357f7b5a69f8a717a234a77485319a41b37c6d1343b17077a8e"}
Sep 07 21:04:49.692457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.692437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9" event={"ID":"90b9ced7-cdfb-4739-adcf-7c527a932863","Type":"ContainerStarted","Data":"6a25bb2902c24714111ecdf71acf4ba839bd362ecdd7e3c7a204ce277ad53520"}
Sep 07 21:04:49.698819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.698801    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.705536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.705517    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.711754 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.711740    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.715352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.715333    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:49.718263 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.718240    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.720695 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.720678    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:49.725101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.725086    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.731635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.731619    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.737749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.737731    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.738047 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.738028    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.738127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738054    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.738127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738071    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.738320 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.738303    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.738362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738328    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.738362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738344    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.738578 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.738564    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.738614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738581    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.738614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738594    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.738839 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.738824    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.738876 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738843    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.738876 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.738856    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.739145 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.739126    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.739217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739150    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.739217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739169    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.739425 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.739404    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.739469 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739425    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.739469 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739439    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.739689 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:04:49.739673    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.739738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739692    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.739738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739705    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.739988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739965    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.739988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.739988    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.740237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740218    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.740237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740235    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.740470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740455    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.740470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740469    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.740673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740657    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.740732 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740673    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.740884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740869    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.740884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.740883    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.741126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741107    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.741169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741129    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.741348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741330    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.741386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741350    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.741589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741568    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.741589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741589    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.741818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741801    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.741818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.741818    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.742043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742028    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.742091 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742042    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.742263 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742245    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.742304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742264    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.742479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742459    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.742479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742478    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.742682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742666    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.742725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742683    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.742909 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742883    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.743045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.742909    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.743415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.743370    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.743415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.743406    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.743813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.743786    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.743899 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.743815    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.744113 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744094    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.744172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744113    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.744350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744334    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.744389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744351    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.744612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744587    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.744667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744614    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.744871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744852    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.744871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744871    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.744991 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.744896    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:49.745112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745090    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.745156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745114    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.745274 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745259    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy"
Sep 07 21:04:49.745309 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745276    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy"
Sep 07 21:04:49.745309 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745290    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="prometheus"
Sep 07 21:04:49.745309 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745296    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="prometheus"
Sep 07 21:04:49.745309 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745302    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-thanos"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745311    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-thanos"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745316    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745323    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="init-config-reloader"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745330    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745332    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="init-config-reloader"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745374    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="config-reloader"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745381    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="config-reloader"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745397    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="thanos-sidecar"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745402    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="thanos-sidecar"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745410    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-web"
Sep 07 21:04:49.745436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745416    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-web"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745506    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-thanos"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745517    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="config-reloader"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745525    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745533    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="kube-rbac-proxy-web"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745539    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="prometheus"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745545    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" containerName="thanos-sidecar"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745570    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.745786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745587    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.746064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745811    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.746064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.745829    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.746064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746054    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.746172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746072    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.746320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746304    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.746362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746320    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.746546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746527    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.746595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746546    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.746773 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746753    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.746773 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746772    2583 scope.go:117] "RemoveContainer" containerID="497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"
Sep 07 21:04:49.746998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746982    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84"} err="failed to get container status \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": rpc error: code = NotFound desc = could not find container \"497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84\": container with ID starting with 497461a75517bbe596410fc96c013b1af0bbca63c20065038272f599308e7e84 not found: ID does not exist"
Sep 07 21:04:49.747060 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.746998    2583 scope.go:117] "RemoveContainer" containerID="816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"
Sep 07 21:04:49.747221 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747203    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a"} err="failed to get container status \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": rpc error: code = NotFound desc = could not find container \"816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a\": container with ID starting with 816ebafc0adb5abaa26406258f51c727f2fb78dac378973f30f3292177d9ef1a not found: ID does not exist"
Sep 07 21:04:49.747273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747222    2583 scope.go:117] "RemoveContainer" containerID="e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"
Sep 07 21:04:49.747446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747429    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8"} err="failed to get container status \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": rpc error: code = NotFound desc = could not find container \"e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8\": container with ID starting with e0e86d2e1a5fde16c4d56dd4f2a2c2c78b315a6e8259907ba6c7cba68148aab8 not found: ID does not exist"
Sep 07 21:04:49.747490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747446    2583 scope.go:117] "RemoveContainer" containerID="4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"
Sep 07 21:04:49.747668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747650    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6"} err="failed to get container status \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": rpc error: code = NotFound desc = could not find container \"4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6\": container with ID starting with 4cff99810b01f5683ad02104b5dba653c97fcf0fa260857e6a887f39efd908b6 not found: ID does not exist"
Sep 07 21:04:49.747721 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747668    2583 scope.go:117] "RemoveContainer" containerID="9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"
Sep 07 21:04:49.747870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747855    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4"} err="failed to get container status \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": rpc error: code = NotFound desc = could not find container \"9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4\": container with ID starting with 9079d63359c96598916930aaa6ad0241a8e4d5964481231a3608a66108dfd8b4 not found: ID does not exist"
Sep 07 21:04:49.747907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.747870    2583 scope.go:117] "RemoveContainer" containerID="1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"
Sep 07 21:04:49.748137 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.748119    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4"} err="failed to get container status \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": rpc error: code = NotFound desc = could not find container \"1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4\": container with ID starting with 1f8e6b66342b9a2b428b6f5ecc0f029f5d36b20fe2eb60938e4aa90fffacdec4 not found: ID does not exist"
Sep 07 21:04:49.748194 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.748137    2583 scope.go:117] "RemoveContainer" containerID="a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"
Sep 07 21:04:49.748347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.748332    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e"} err="failed to get container status \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": rpc error: code = NotFound desc = could not find container \"a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e\": container with ID starting with a27752fb39aed00d2cc327ad207df59d440507c0a8966b9cf9affdf57edb784e not found: ID does not exist"
Sep 07 21:04:49.748971 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.748953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.751251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751231    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 21:04:49.751421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751371    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 21:04:49.751510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 21:04:49.751564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751551    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 21:04:49.751621 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751565    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bvzf9\""
Sep 07 21:04:49.751621 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751580    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 21:04:49.751719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751641    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 21:04:49.751719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751673    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 21:04:49.751719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751675    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a6rbasg53n30l\""
Sep 07 21:04:49.751842 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 21:04:49.751902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.751889    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 21:04:49.752024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.752005    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 21:04:49.752105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.752026    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 21:04:49.752105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.752058    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 21:04:49.752201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.752116    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 21:04:49.754716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.754697    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 21:04:49.757340 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.757323    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 21:04:49.765272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.765246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:49.917038 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917150    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksmv\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-kube-api-access-7ksmv\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917417    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:49.917743 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:49.917458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.018905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.018806    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019396    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksmv\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-kube-api-access-7ksmv\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.019767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.020311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.019463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.020537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.020617 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.020581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.021760 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.021731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config-out\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.022241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.021907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.022241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.021987    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.022241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.022076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.022691 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.022524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.023218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.023187    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.023321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.023303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.023499 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.023475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.023574 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.023550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fceaf9e9-7b9a-419c-8ebf-a21547270a09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.024237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.024214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.024443 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.024425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-web-config\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.024570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.024554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.024822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.024805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceaf9e9-7b9a-419c-8ebf-a21547270a09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.028925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.028904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksmv\" (UniqueName: \"kubernetes.io/projected/fceaf9e9-7b9a-419c-8ebf-a21547270a09-kube-api-access-7ksmv\") pod \"prometheus-k8s-0\" (UID: \"fceaf9e9-7b9a-419c-8ebf-a21547270a09\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.059175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.059142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:04:50.338193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.338112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:04:50.341208 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:04:50.341176    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceaf9e9_7b9a_419c_8ebf_a21547270a09.slice/crio-91f7c312372fd3f777ae7d3fde295da415e98d5eeb22f506f2044cae89cbd04e WatchSource:0}: Error finding container 91f7c312372fd3f777ae7d3fde295da415e98d5eeb22f506f2044cae89cbd04e: Status 404 returned error can't find the container with id 91f7c312372fd3f777ae7d3fde295da415e98d5eeb22f506f2044cae89cbd04e
Sep 07 21:04:50.677491 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.677455    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba23a81b-85b1-4dfb-839f-0223014320b6" path="/var/lib/kubelet/pods/ba23a81b-85b1-4dfb-839f-0223014320b6/volumes"
Sep 07 21:04:50.701387 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.701356    2583 generic.go:356] "Generic (PLEG): container finished" podID="fceaf9e9-7b9a-419c-8ebf-a21547270a09" containerID="03031f52262ab4ce0e8fea7524f4421e6f6eb0519d18ff49c082eac872386cca" exitCode=0
Sep 07 21:04:50.701763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.701442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerDied","Data":"03031f52262ab4ce0e8fea7524f4421e6f6eb0519d18ff49c082eac872386cca"}
Sep 07 21:04:50.701763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:50.701518    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"91f7c312372fd3f777ae7d3fde295da415e98d5eeb22f506f2044cae89cbd04e"}
Sep 07 21:04:51.709365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.709328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9" event={"ID":"90b9ced7-cdfb-4739-adcf-7c527a932863","Type":"ContainerStarted","Data":"6cc1410e6aeb1137c93e9c8647941aaf965fea745593557942462a790fce88fb"}
Sep 07 21:04:51.709789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.709397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9" event={"ID":"90b9ced7-cdfb-4739-adcf-7c527a932863","Type":"ContainerStarted","Data":"f4191da86179c7ec9e4527523de34903ae04de2123c4fd15040e6728c7b49754"}
Sep 07 21:04:51.709789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.709425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9" event={"ID":"90b9ced7-cdfb-4739-adcf-7c527a932863","Type":"ContainerStarted","Data":"9a2f5513ba601cd2dc2a1bae00bd583b4c8871d86ed2d13db278ab558e7bd87a"}
Sep 07 21:04:51.712734 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.712708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"f1d977a203efd8ff42a44441041f2a5eed92d2a1aaf0e267fd1553492d3a792f"}
Sep 07 21:04:51.713730 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.713124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"2c273c50a9396fc0d7ecc83ffe5a82f6b7505ebd696d6957a1719de3e4f07cd2"}
Sep 07 21:04:51.713847 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.713833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"da06ebf241b4d744f0c3e80ab6116478043b8f754e2f11ba4e03e82d3035cdd4"}
Sep 07 21:04:51.713901 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.713890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"095e0c43c8fd7c041ceb2ce3d490c21d0e79c877b4caef844744507cc0b6cf86"}
Sep 07 21:04:51.713998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.713982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"50ddd6284c906d132fcb3bdb133731cb86dd4753ead549eeccefdbcf2e98118c"}
Sep 07 21:04:51.714243 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.714229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fceaf9e9-7b9a-419c-8ebf-a21547270a09","Type":"ContainerStarted","Data":"645009ca249058aa8fb28379e7be43a3dc7fe517622ecb4ca92ae9f200b53bea"}
Sep 07 21:04:51.732631 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.732585    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68f8f67cd-87jd9" podStartSLOduration=2.025410093 podStartE2EDuration="3.732570504s" totalImagesPullingTime="1.707160411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:51.730686856 +0000 UTC m=+203.566812961" watchObservedRunningTime="2026-09-07 21:04:51.732570504 +0000 UTC m=+203.568696610"
Sep 07 21:04:51.779820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.779766    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.756052068 podStartE2EDuration="2.779748688s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.69662ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:04:51.777617456 +0000 UTC m=+203.613743576" watchObservedRunningTime="2026-09-07 21:04:51.779748688 +0000 UTC m=+203.615874792"
Sep 07 21:04:51.890765 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.890735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:51.991856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:51.991772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:04:55.060013 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:04:55.059936    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:05:02.339790 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:02.339754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:02.441585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:02.441548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:02.541245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:02.541205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:29.949688 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:29.949652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:50.060145 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:50.060112    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:05:50.075516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:50.075487    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:05:50.950681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:50.950649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:05:55.505811 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:55.505768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:59.048200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:59.048164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:59.100046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:59.100014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:59.753725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:59.753685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:05:59.807667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:05:59.807636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:10.605732 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:10.605688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:10.704955 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:10.704908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:10.803419 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:10.803379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:10.986806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:10.986769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:11.039912 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:11.039879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:15.350568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:15.350538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:15.451601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:15.451558    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:28.595331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:28.595298    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:06:28.598512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:28.598490    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 21:06:28.602493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:28.602474    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:06:37.022798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:37.022758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:37.123564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:37.123528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:58.633344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:58.633309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:06:59.418617 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:06:59.418581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:02.229358 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:02.229320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:02.287148 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:02.287111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:03.954813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:03.954771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:04.107608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:04.107568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:04.199781 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:04.199749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:06.475962 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:06.475908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:07.729429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:07.729353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:09.030930 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:09.030885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:09.131446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:09.131403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:13.890092 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:13.890053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:15.509339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.509304    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wftzl"]
Sep 07 21:07:15.512486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.512461    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.514680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.514656    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 21:07:15.514797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.514657    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 21:07:15.515201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.515185    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bdc6l\""
Sep 07 21:07:15.522103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.522080    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wftzl"]
Sep 07 21:07:15.682985 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.682908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-bound-sa-token\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.683167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.683049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6q8\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-kube-api-access-mf6q8\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.784352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.784252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6q8\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-kube-api-access-mf6q8\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.784352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.784330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-bound-sa-token\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.794133 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.794097    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-bound-sa-token\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.794248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.794226    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6q8\" (UniqueName: \"kubernetes.io/projected/8f08f009-a754-4ab2-9fae-13062dc21700-kube-api-access-mf6q8\") pod \"cert-manager-55b4d954d5-wftzl\" (UID: \"8f08f009-a754-4ab2-9fae-13062dc21700\") " pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:15.822104 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:15.822071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wftzl"
Sep 07 21:07:16.091714 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:16.091640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wftzl"]
Sep 07 21:07:16.094850 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:07:16.094822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f08f009_a754_4ab2_9fae_13062dc21700.slice/crio-d90374bb44d2e5a1592d9bdf58bdfcf81db6264bc6b0f57766ba496bc797af21 WatchSource:0}: Error finding container d90374bb44d2e5a1592d9bdf58bdfcf81db6264bc6b0f57766ba496bc797af21: Status 404 returned error can't find the container with id d90374bb44d2e5a1592d9bdf58bdfcf81db6264bc6b0f57766ba496bc797af21
Sep 07 21:07:16.096792 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:16.096775    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:07:16.273225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:16.273187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wftzl" event={"ID":"8f08f009-a754-4ab2-9fae-13062dc21700","Type":"ContainerStarted","Data":"d90374bb44d2e5a1592d9bdf58bdfcf81db6264bc6b0f57766ba496bc797af21"}
Sep 07 21:07:16.706222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:16.706047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:16.806554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:16.806509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:18.437153 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.437113    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"]
Sep 07 21:07:18.441061 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.441033    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.443396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.443370    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 21:07:18.443524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.443427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:07:18.444220 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.444200    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nmw8q\""
Sep 07 21:07:18.450200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.450175    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"]
Sep 07 21:07:18.509510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.509469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502c205-1151-44b8-be90-bd1c6eced6c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.509679 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.509529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6nv4\" (UniqueName: \"kubernetes.io/projected/8502c205-1151-44b8-be90-bd1c6eced6c8-kube-api-access-b6nv4\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.610819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.610778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502c205-1151-44b8-be90-bd1c6eced6c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.610819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.610828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6nv4\" (UniqueName: \"kubernetes.io/projected/8502c205-1151-44b8-be90-bd1c6eced6c8-kube-api-access-b6nv4\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.611286 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.611263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8502c205-1151-44b8-be90-bd1c6eced6c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.621311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.621280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6nv4\" (UniqueName: \"kubernetes.io/projected/8502c205-1151-44b8-be90-bd1c6eced6c8-kube-api-access-b6nv4\") pod \"openshift-lws-operator-fd8ccff4c-wkfmm\" (UID: \"8502c205-1151-44b8-be90-bd1c6eced6c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:18.752596 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:18.752505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"
Sep 07 21:07:19.226080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:19.226043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm"]
Sep 07 21:07:19.229726 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:07:19.229692    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8502c205_1151_44b8_be90_bd1c6eced6c8.slice/crio-d2124789bffb720c7bb6be15b20ef373ece7f83bd8abd0252d26ad342f979133 WatchSource:0}: Error finding container d2124789bffb720c7bb6be15b20ef373ece7f83bd8abd0252d26ad342f979133: Status 404 returned error can't find the container with id d2124789bffb720c7bb6be15b20ef373ece7f83bd8abd0252d26ad342f979133
Sep 07 21:07:19.289390 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:19.289298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wftzl" event={"ID":"8f08f009-a754-4ab2-9fae-13062dc21700","Type":"ContainerStarted","Data":"6f48900b74299e5eed0dba3cf08d27217a63e8fae9a8e58c152b6b7371b67f04"}
Sep 07 21:07:19.290720 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:19.290694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm" event={"ID":"8502c205-1151-44b8-be90-bd1c6eced6c8","Type":"ContainerStarted","Data":"d2124789bffb720c7bb6be15b20ef373ece7f83bd8abd0252d26ad342f979133"}
Sep 07 21:07:19.304437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:19.304388    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wftzl" podStartSLOduration=1.368061994 podStartE2EDuration="4.304372474s" totalImagesPullingTime="2.93631048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:19.303770983 +0000 UTC m=+351.139897088" watchObservedRunningTime="2026-09-07 21:07:19.304372474 +0000 UTC m=+351.140498579"
Sep 07 21:07:22.306520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:22.306482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm" event={"ID":"8502c205-1151-44b8-be90-bd1c6eced6c8","Type":"ContainerStarted","Data":"c33f8babd4b4afb2240eb29b11bc16eaa7070bbf6cc9401fb78e51dcdb347857"}
Sep 07 21:07:22.322511 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:22.322459    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wkfmm" podStartSLOduration=1.843921988 podStartE2EDuration="4.322443756s" totalImagesPullingTime="2.478521768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:22.321553216 +0000 UTC m=+354.157679324" watchObservedRunningTime="2026-09-07 21:07:22.322443756 +0000 UTC m=+354.158569862"
Sep 07 21:07:23.131822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:23.131787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:23.231873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:23.231830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:24.998693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:24.998655    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:38.827172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:38.827136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:40.661889 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:40.661851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:40.762276 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:40.762241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.081895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.081799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.277484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.277451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.395717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.395633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.471074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.471040    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"]
Sep 07 21:07:41.474761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.474739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.477220 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.477193    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 21:07:41.477365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.477348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 21:07:41.477544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.477531    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 21:07:41.477753 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.477735    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 21:07:41.478173 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.478158    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wgpwk\""
Sep 07 21:07:41.496303 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.496277    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"]
Sep 07 21:07:41.589327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.589287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.607710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.607671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.607834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.607717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lpl\" (UniqueName: \"kubernetes.io/projected/e86cc64b-715e-40bd-940e-3a20bbb87be3-kube-api-access-t6lpl\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.607834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.607792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.607903 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.607832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.607903 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.607857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.689102 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.689067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.708276 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.708420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.708420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.708420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.708420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lpl\" (UniqueName: \"kubernetes.io/projected/e86cc64b-715e-40bd-940e-3a20bbb87be3-kube-api-access-t6lpl\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.708723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.708697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-manifests\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.710775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.710745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e86cc64b-715e-40bd-940e-3a20bbb87be3-tmp\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.710875 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.710841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-webhook-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.710979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.710958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e86cc64b-715e-40bd-940e-3a20bbb87be3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.719817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.719795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lpl\" (UniqueName: \"kubernetes.io/projected/e86cc64b-715e-40bd-940e-3a20bbb87be3-kube-api-access-t6lpl\") pod \"opendatahub-operator-controller-manager-56489b9975-w47f6\" (UID: \"e86cc64b-715e-40bd-940e-3a20bbb87be3\") " pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.784892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.784843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:41.789479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.789444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.896462 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.896423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:41.990501 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:41.990410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:42.062270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:42.062235    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"]
Sep 07 21:07:42.065606 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:07:42.065579    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86cc64b_715e_40bd_940e_3a20bbb87be3.slice/crio-c5b1b55bfe20db08cc86dd14968cadf1d1d8e1eae9a0d584730a5b83e18260f0 WatchSource:0}: Error finding container c5b1b55bfe20db08cc86dd14968cadf1d1d8e1eae9a0d584730a5b83e18260f0: Status 404 returned error can't find the container with id c5b1b55bfe20db08cc86dd14968cadf1d1d8e1eae9a0d584730a5b83e18260f0
Sep 07 21:07:42.389529 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:42.389437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6" event={"ID":"e86cc64b-715e-40bd-940e-3a20bbb87be3","Type":"ContainerStarted","Data":"c5b1b55bfe20db08cc86dd14968cadf1d1d8e1eae9a0d584730a5b83e18260f0"}
Sep 07 21:07:45.406178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:45.406145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6" event={"ID":"e86cc64b-715e-40bd-940e-3a20bbb87be3","Type":"ContainerStarted","Data":"b49ffed3e4783fe4f66da8ba145530ef016ca05b712751242d98b4d47ee7eb59"}
Sep 07 21:07:46.412384 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:46.412352    2583 generic.go:356] "Generic (PLEG): container finished" podID="e86cc64b-715e-40bd-940e-3a20bbb87be3" containerID="b49ffed3e4783fe4f66da8ba145530ef016ca05b712751242d98b4d47ee7eb59" exitCode=0
Sep 07 21:07:46.412800 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:46.412454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6" event={"ID":"e86cc64b-715e-40bd-940e-3a20bbb87be3","Type":"ContainerDied","Data":"b49ffed3e4783fe4f66da8ba145530ef016ca05b712751242d98b4d47ee7eb59"}
Sep 07 21:07:47.420389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:47.420351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6" event={"ID":"e86cc64b-715e-40bd-940e-3a20bbb87be3","Type":"ContainerStarted","Data":"96b1d81c2419504928abf38ece2004598871c6ec3a9cef9ea3c6ccc9f148d0f5"}
Sep 07 21:07:47.420820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:47.420466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:07:47.442096 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:47.442042    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6" podStartSLOduration=1.8793600050000001 podStartE2EDuration="6.442020062s" totalImagesPullingTime="3.46992335s" totalInitContainerRuntime="1.092736707s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:07:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:07:47.43982465 +0000 UTC m=+379.275950779" watchObservedRunningTime="2026-09-07 21:07:47.442020062 +0000 UTC m=+379.278146171"
Sep 07 21:07:54.074018 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:54.073959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:54.178246 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:54.178209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:07:58.427725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:07:58.427692    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56489b9975-w47f6"
Sep 07 21:08:00.433183 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:00.433141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:00.538760 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:00.538722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:00.759568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:00.759483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:01.205247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:01.205208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:01.978863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:01.978815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:02.036249 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:02.036210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:02.828726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:02.828679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:07.518715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:07.518680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:07.626855 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:07.626817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:08.095201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:08.095165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:08.194764 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:08.194723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:08.295847 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:08.295815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:11.387244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:11.387207    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:11.488028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:11.487985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:11.590314 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:11.590276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:11.764690 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:11.764657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:11.905024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:11.904988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:12.335574 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:12.335538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:16.920742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.920706    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548d74cdf5-lw9hk"]
Sep 07 21:08:16.932251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.932225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:16.936184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.936129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrrkg\""
Sep 07 21:08:16.936350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.936218    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 21:08:16.936350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.936285    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 21:08:16.936505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.936379    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 21:08:16.937104 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.937082    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 21:08:16.937201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.937123    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 21:08:16.943195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.943172    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 21:08:16.954323 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:16.954292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d74cdf5-lw9hk"]
Sep 07 21:08:17.013875 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.013838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhr7\" (UniqueName: \"kubernetes.io/projected/b83a0c55-4391-4c4a-8824-d43ef673810a-kube-api-access-xqhr7\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.013875 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.013876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-service-ca\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.014094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.013902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-trusted-ca-bundle\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.014094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.013967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.014094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.013992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-oauth-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.014094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.014027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-console-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.014094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.014082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-oauth-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.032824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.032788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:17.108589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.108506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:17.114596 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-console-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-oauth-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhr7\" (UniqueName: \"kubernetes.io/projected/b83a0c55-4391-4c4a-8824-d43ef673810a-kube-api-access-xqhr7\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-service-ca\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-trusted-ca-bundle\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.114788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.114781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-oauth-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.115591 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.115562    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-oauth-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.116116 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.116090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-console-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.117555 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.117131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-service-ca\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.117555 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.117254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b83a0c55-4391-4c4a-8824-d43ef673810a-trusted-ca-bundle\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.120196 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.120153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-serving-cert\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.126180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.126131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhr7\" (UniqueName: \"kubernetes.io/projected/b83a0c55-4391-4c4a-8824-d43ef673810a-kube-api-access-xqhr7\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.132749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.132684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b83a0c55-4391-4c4a-8824-d43ef673810a-console-oauth-config\") pod \"console-548d74cdf5-lw9hk\" (UID: \"b83a0c55-4391-4c4a-8824-d43ef673810a\") " pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.242580 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.242488    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:17.533842 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.533815    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d74cdf5-lw9hk"]
Sep 07 21:08:17.536694 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:08:17.536669    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83a0c55_4391_4c4a_8824_d43ef673810a.slice/crio-d17e3ab49e33bc561dd99f5347bc7a0066a729fb037901228960db090be7da42 WatchSource:0}: Error finding container d17e3ab49e33bc561dd99f5347bc7a0066a729fb037901228960db090be7da42: Status 404 returned error can't find the container with id d17e3ab49e33bc561dd99f5347bc7a0066a729fb037901228960db090be7da42
Sep 07 21:08:17.559930 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:17.559900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d74cdf5-lw9hk" event={"ID":"b83a0c55-4391-4c4a-8824-d43ef673810a","Type":"ContainerStarted","Data":"d17e3ab49e33bc561dd99f5347bc7a0066a729fb037901228960db090be7da42"}
Sep 07 21:08:18.573772 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:18.573733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d74cdf5-lw9hk" event={"ID":"b83a0c55-4391-4c4a-8824-d43ef673810a","Type":"ContainerStarted","Data":"fb00d51e6e7f698b22c2105a42bdc594e84c781bb01207901e4b46f64d03837c"}
Sep 07 21:08:18.604545 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:18.604494    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548d74cdf5-lw9hk" podStartSLOduration=2.604478833 podStartE2EDuration="2.604478833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:18.603357307 +0000 UTC m=+410.439483414" watchObservedRunningTime="2026-09-07 21:08:18.604478833 +0000 UTC m=+410.440604937"
Sep 07 21:08:19.576991 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.576932    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"]
Sep 07 21:08:19.580198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.580178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.582602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.582578    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 21:08:19.582602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.582594    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 21:08:19.583416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.583396    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j5q6n\""
Sep 07 21:08:19.583523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.583502    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 21:08:19.588700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.588676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"]
Sep 07 21:08:19.631871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.631840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hc4\" (UniqueName: \"kubernetes.io/projected/abe26247-0396-4820-9b15-6eff1b0e3735-kube-api-access-t8hc4\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.632063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.631956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abe26247-0396-4820-9b15-6eff1b0e3735-manager-config\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.632063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.632014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-metrics-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.632218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.632193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.733072 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.733012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abe26247-0396-4820-9b15-6eff1b0e3735-manager-config\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.733072 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.733053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-metrics-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.733467 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.733108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.733467 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.733160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hc4\" (UniqueName: \"kubernetes.io/projected/abe26247-0396-4820-9b15-6eff1b0e3735-kube-api-access-t8hc4\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.733860 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.733832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abe26247-0396-4820-9b15-6eff1b0e3735-manager-config\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.735788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.735761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.735885 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.735798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abe26247-0396-4820-9b15-6eff1b0e3735-metrics-cert\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.746272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.746234    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hc4\" (UniqueName: \"kubernetes.io/projected/abe26247-0396-4820-9b15-6eff1b0e3735-kube-api-access-t8hc4\") pod \"lws-controller-manager-75546db857-8j2rw\" (UID: \"abe26247-0396-4820-9b15-6eff1b0e3735\") " pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:19.891005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:19.890878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:20.190431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.190404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"]
Sep 07 21:08:20.192528 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:08:20.192506    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe26247_0396_4820_9b15_6eff1b0e3735.slice/crio-73d366a199c137192d175c358fb9a25c666202ba3d6f4d87c68769c95d51490e WatchSource:0}: Error finding container 73d366a199c137192d175c358fb9a25c666202ba3d6f4d87c68769c95d51490e: Status 404 returned error can't find the container with id 73d366a199c137192d175c358fb9a25c666202ba3d6f4d87c68769c95d51490e
Sep 07 21:08:20.582694 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.582576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:20.586373 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.586339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw" event={"ID":"abe26247-0396-4820-9b15-6eff1b0e3735","Type":"ContainerStarted","Data":"73d366a199c137192d175c358fb9a25c666202ba3d6f4d87c68769c95d51490e"}
Sep 07 21:08:20.637779 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.637741    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"]
Sep 07 21:08:20.642700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.642661    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"]
Sep 07 21:08:20.642849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.642815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.645147 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.645119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 21:08:20.645260 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.645213    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kc9qc\""
Sep 07 21:08:20.646016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.645999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.648089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.648071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 21:08:20.648204 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.648072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mp4g5\""
Sep 07 21:08:20.652231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.652214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"]
Sep 07 21:08:20.656332 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.656309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"]
Sep 07 21:08:20.667794 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.667761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:20.742713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.742678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g28\" (UniqueName: \"kubernetes.io/projected/f7879f2f-f9c9-47b1-821f-9968b62e90c3-kube-api-access-d4g28\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.742713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.742714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7879f2f-f9c9-47b1-821f-9968b62e90c3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.742920 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.742776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.742920 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.742810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhwsj\" (UniqueName: \"kubernetes.io/projected/5faa93de-ba3b-4605-a306-748d1bee4d45-kube-api-access-rhwsj\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.819005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.818972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:20.844290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.844206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g28\" (UniqueName: \"kubernetes.io/projected/f7879f2f-f9c9-47b1-821f-9968b62e90c3-kube-api-access-d4g28\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.844290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.844255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7879f2f-f9c9-47b1-821f-9968b62e90c3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.844525 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.844294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.844525 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.844344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhwsj\" (UniqueName: \"kubernetes.io/projected/5faa93de-ba3b-4605-a306-748d1bee4d45-kube-api-access-rhwsj\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.844525 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:08:20.844464    2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 07 21:08:20.844525 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:08:20.844521    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert podName:5faa93de-ba3b-4605-a306-748d1bee4d45 nodeName:}" failed. No retries permitted until 2026-09-07 21:08:21.344502905 +0000 UTC m=+413.180628988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert") pod "kserve-controller-manager-d6f4b65b8-f42kr" (UID: "5faa93de-ba3b-4605-a306-748d1bee4d45") : secret "kserve-webhook-server-cert" not found
Sep 07 21:08:20.847450 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.847424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7879f2f-f9c9-47b1-821f-9968b62e90c3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.864552 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.864523    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g28\" (UniqueName: \"kubernetes.io/projected/f7879f2f-f9c9-47b1-821f-9968b62e90c3-kube-api-access-d4g28\") pod \"llmisvc-controller-manager-777c6bd7d5-tsnff\" (UID: \"f7879f2f-f9c9-47b1-821f-9968b62e90c3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:20.865335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.865313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhwsj\" (UniqueName: \"kubernetes.io/projected/5faa93de-ba3b-4605-a306-748d1bee4d45-kube-api-access-rhwsj\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:20.964690 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:20.964654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:21.246688 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:21.246661    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"]
Sep 07 21:08:21.350258 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:21.350224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:21.350444 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:08:21.350413    2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 07 21:08:21.350513 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:08:21.350495    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert podName:5faa93de-ba3b-4605-a306-748d1bee4d45 nodeName:}" failed. No retries permitted until 2026-09-07 21:08:22.350474418 +0000 UTC m=+414.186600506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert") pod "kserve-controller-manager-d6f4b65b8-f42kr" (UID: "5faa93de-ba3b-4605-a306-748d1bee4d45") : secret "kserve-webhook-server-cert" not found
Sep 07 21:08:21.427276 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:21.427237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:21.578408 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:08:21.578330    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf7879f2f_f9c9_47b1_821f_9968b62e90c3.slice/crio-951e8fcb8fa14eccbcd293f9dc896a570ab5f7fd211de1fc932bd50c381621ee WatchSource:0}: Error finding container 951e8fcb8fa14eccbcd293f9dc896a570ab5f7fd211de1fc932bd50c381621ee: Status 404 returned error can't find the container with id 951e8fcb8fa14eccbcd293f9dc896a570ab5f7fd211de1fc932bd50c381621ee
Sep 07 21:08:21.591904 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:21.591873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff" event={"ID":"f7879f2f-f9c9-47b1-821f-9968b62e90c3","Type":"ContainerStarted","Data":"951e8fcb8fa14eccbcd293f9dc896a570ab5f7fd211de1fc932bd50c381621ee"}
Sep 07 21:08:22.256176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.256138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:22.356413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.356385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:22.361480 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.361451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:22.363935 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.363917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5faa93de-ba3b-4605-a306-748d1bee4d45-cert\") pod \"kserve-controller-manager-d6f4b65b8-f42kr\" (UID: \"5faa93de-ba3b-4605-a306-748d1bee4d45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:22.457442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.457403    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:22.607987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.607873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw" event={"ID":"abe26247-0396-4820-9b15-6eff1b0e3735","Type":"ContainerStarted","Data":"f590dceba3ff826d9befc8c3b2db3c7922e29080ea46322310f8bd14fb6cee81"}
Sep 07 21:08:22.608414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.608238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:22.638544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:22.638478    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw" podStartSLOduration=2.196738061 podStartE2EDuration="3.638457983s" totalImagesPullingTime="1.441719922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:22.635910763 +0000 UTC m=+414.472036879" watchObservedRunningTime="2026-09-07 21:08:22.638457983 +0000 UTC m=+414.474584157"
Sep 07 21:08:23.068291 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:23.068259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"]
Sep 07 21:08:23.071402 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:08:23.071360    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5faa93de_ba3b_4605_a306_748d1bee4d45.slice/crio-147976a835805a90cdda743e3ee99d8059ebe075f7f9bd2d646c259eb02a79ef WatchSource:0}: Error finding container 147976a835805a90cdda743e3ee99d8059ebe075f7f9bd2d646c259eb02a79ef: Status 404 returned error can't find the container with id 147976a835805a90cdda743e3ee99d8059ebe075f7f9bd2d646c259eb02a79ef
Sep 07 21:08:23.614396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:23.614345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr" event={"ID":"5faa93de-ba3b-4605-a306-748d1bee4d45","Type":"ContainerStarted","Data":"147976a835805a90cdda743e3ee99d8059ebe075f7f9bd2d646c259eb02a79ef"}
Sep 07 21:08:24.620754 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:24.620663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff" event={"ID":"f7879f2f-f9c9-47b1-821f-9968b62e90c3","Type":"ContainerStarted","Data":"aa7faab39da327879b31c2ce5e79d051e4a7e8ebad51ef74e2412f9f590d6129"}
Sep 07 21:08:24.620754 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:24.620728    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:08:24.638043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:24.637994    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff" podStartSLOduration=2.005215054 podStartE2EDuration="4.637978507s" totalImagesPullingTime="2.632763453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:24.637085616 +0000 UTC m=+416.473211721" watchObservedRunningTime="2026-09-07 21:08:24.637978507 +0000 UTC m=+416.474104612"
Sep 07 21:08:27.243554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.243514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:27.244059 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.243583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:27.249979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.249920    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:27.640487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.640410    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548d74cdf5-lw9hk"
Sep 07 21:08:27.786269 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.786235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:27.889086 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:27.889039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:08:28.641896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:28.641852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr" event={"ID":"5faa93de-ba3b-4605-a306-748d1bee4d45","Type":"ContainerStarted","Data":"3fd66df07821f9478842e1f5fc6929bb3a2b305b0b6864f1a7950b5152d71081"}
Sep 07 21:08:28.658725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:28.658668    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr" podStartSLOduration=4.03976784 podStartE2EDuration="8.658653468s" totalImagesPullingTime="4.618885628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:28.657531887 +0000 UTC m=+420.493657992" watchObservedRunningTime="2026-09-07 21:08:28.658653468 +0000 UTC m=+420.494779576"
Sep 07 21:08:29.646557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:29.646524    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:08:33.616975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:33.616926    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75546db857-8j2rw"
Sep 07 21:08:55.627426 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:08:55.627388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tsnff"
Sep 07 21:09:00.218494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:00.218436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:00.655265 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:00.655237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f42kr"
Sep 07 21:09:02.166351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:02.166312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:02.217442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:02.217404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:12.411541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:12.411500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:12.510035 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:12.510001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:54.219087 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:54.219046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:55.019928 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:55.019896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:55.810334 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:55.810298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:58.421504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:58.421470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:58.977700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:58.977661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:59.071127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:59.071091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:09:59.429699 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:09:59.429661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:00.755449 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.755416    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"]
Sep 07 21:10:00.758687 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.758665    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:00.760992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.760971    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 21:10:00.761681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.761661    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nqcnm\""
Sep 07 21:10:00.761775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.761678    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 21:10:00.769460 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.769439    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"]
Sep 07 21:10:00.806832 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.806797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnj4\" (UniqueName: \"kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4\") pod \"limitador-operator-controller-manager-6c549b6d85-htf9w\" (UID: \"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:00.908165 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.908123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnj4\" (UniqueName: \"kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4\") pod \"limitador-operator-controller-manager-6c549b6d85-htf9w\" (UID: \"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:00.918746 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:00.918707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnj4\" (UniqueName: \"kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4\") pod \"limitador-operator-controller-manager-6c549b6d85-htf9w\" (UID: \"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:01.068523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:01.068432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:01.361136 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:01.361111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"]
Sep 07 21:10:01.363695 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:10:01.363667    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0e5f3e_4ae0_4fff_a57a_12ef2756f634.slice/crio-852eed9a5a73d8a6837a93c02913f1dddfda7bd7a97bbd4438f5263d2d001b50 WatchSource:0}: Error finding container 852eed9a5a73d8a6837a93c02913f1dddfda7bd7a97bbd4438f5263d2d001b50: Status 404 returned error can't find the container with id 852eed9a5a73d8a6837a93c02913f1dddfda7bd7a97bbd4438f5263d2d001b50
Sep 07 21:10:01.438660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:01.438628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:01.541235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:01.541197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:02.049613 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:02.049572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w" event={"ID":"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634","Type":"ContainerStarted","Data":"852eed9a5a73d8a6837a93c02913f1dddfda7bd7a97bbd4438f5263d2d001b50"}
Sep 07 21:10:02.659317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:02.659281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:03.424222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:03.424187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:03.825606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:03.825516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:04.870526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:04.870492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:04.978091 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:04.978053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:05.068742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:05.068705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w" event={"ID":"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634","Type":"ContainerStarted","Data":"6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf"}
Sep 07 21:10:05.068892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:05.068844    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:05.084872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:05.084781    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w" podStartSLOduration=2.226611935 podStartE2EDuration="5.084767646s" totalImagesPullingTime="2.858155711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:05.08373999 +0000 UTC m=+516.919866096" watchObservedRunningTime="2026-09-07 21:10:05.084767646 +0000 UTC m=+516.920893749"
Sep 07 21:10:06.474975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:06.474923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:06.572671 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:06.572639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:09.426487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:09.426451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:09.488643 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:09.488590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:09.828095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:09.828001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:09.893706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:09.893675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:10.230270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:10.230237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:10.331608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:10.331568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:16.076233 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:16.076194    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:16.454618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:16.454573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:16.584788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:16.584752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:17.589045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.589006    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"]
Sep 07 21:10:17.589450 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.589249    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" containerName="manager" containerID="cri-o://6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf" gracePeriod=2
Sep 07 21:10:17.600696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.600668    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"]
Sep 07 21:10:17.602585 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:17.602464    2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-htf9w\": pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:17.614408 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.614385    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"]
Sep 07 21:10:17.614720 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.614708    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" containerName="manager"
Sep 07 21:10:17.614763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.614722    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" containerName="manager"
Sep 07 21:10:17.614795 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.614786    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" containerName="manager"
Sep 07 21:10:17.618054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.618037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:17.620569 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:17.620543    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" is forbidden: User \"system:node:ip-10-0-136-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-145.ec2.internal' and this object" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:17.633445 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.633421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"]
Sep 07 21:10:17.645422 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.645393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxpj\" (UniqueName: \"kubernetes.io/projected/cc7aa14a-a723-4db9-b897-d91a744969e5-kube-api-access-4sxpj\") pod \"limitador-operator-controller-manager-6c549b6d85-kffsf\" (UID: \"cc7aa14a-a723-4db9-b897-d91a744969e5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:17.746762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.746725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxpj\" (UniqueName: \"kubernetes.io/projected/cc7aa14a-a723-4db9-b897-d91a744969e5-kube-api-access-4sxpj\") pod \"limitador-operator-controller-manager-6c549b6d85-kffsf\" (UID: \"cc7aa14a-a723-4db9-b897-d91a744969e5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:17.754540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.754509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxpj\" (UniqueName: \"kubernetes.io/projected/cc7aa14a-a723-4db9-b897-d91a744969e5-kube-api-access-4sxpj\") pod \"limitador-operator-controller-manager-6c549b6d85-kffsf\" (UID: \"cc7aa14a-a723-4db9-b897-d91a744969e5\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:17.829647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.829622    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:17.831577 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:17.831548    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" is forbidden: User \"system:node:ip-10-0-136-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-145.ec2.internal' and this object" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:17.847269 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.847216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfnj4\" (UniqueName: \"kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4\") pod \"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\" (UID: \"2d0e5f3e-4ae0-4fff-a57a-12ef2756f634\") "
Sep 07 21:10:17.849311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.849282    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4" (OuterVolumeSpecName: "kube-api-access-qfnj4") pod "2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" (UID: "2d0e5f3e-4ae0-4fff-a57a-12ef2756f634"). InnerVolumeSpecName "kube-api-access-qfnj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:10:17.948625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.948574    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfnj4\" (UniqueName: \"kubernetes.io/projected/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634-kube-api-access-qfnj4\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:10:17.978869 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:17.978838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:18.132717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.132629    2583 generic.go:356] "Generic (PLEG): container finished" podID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" containerID="6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf" exitCode=0
Sep 07 21:10:18.132717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.132677    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:18.132973 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.132722    2583 scope.go:117] "RemoveContainer" containerID="6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf"
Sep 07 21:10:18.134908 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:18.134876    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" is forbidden: User \"system:node:ip-10-0-136-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-145.ec2.internal' and this object" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:18.141609 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.141591    2583 scope.go:117] "RemoveContainer" containerID="6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf"
Sep 07 21:10:18.141876 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:18.141857    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf\": container with ID starting with 6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf not found: ID does not exist" containerID="6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf"
Sep 07 21:10:18.141966 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.141888    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf"} err="failed to get container status \"6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf\": rpc error: code = NotFound desc = could not find container \"6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf\": container with ID starting with 6d91fc2592ec02f64619c52dda95854b4fb45c0648bc850e011fdb105fe7e1cf not found: ID does not exist"
Sep 07 21:10:18.143281 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:18.143259    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" is forbidden: User \"system:node:ip-10-0-136-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-145.ec2.internal' and this object" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:18.261908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.261879    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"]
Sep 07 21:10:18.264062 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:10:18.264031    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7aa14a_a723_4db9_b897_d91a744969e5.slice/crio-9006dab43e4255580e6dafc58243a17e39fcd022f3e9492c2c077fd63abfd391 WatchSource:0}: Error finding container 9006dab43e4255580e6dafc58243a17e39fcd022f3e9492c2c077fd63abfd391: Status 404 returned error can't find the container with id 9006dab43e4255580e6dafc58243a17e39fcd022f3e9492c2c077fd63abfd391
Sep 07 21:10:18.678668 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:10:18.678614    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-htf9w\" is forbidden: User \"system:node:ip-10-0-136-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-145.ec2.internal' and this object" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-htf9w"
Sep 07 21:10:18.681952 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.681913    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0e5f3e-4ae0-4fff-a57a-12ef2756f634" path="/var/lib/kubelet/pods/2d0e5f3e-4ae0-4fff-a57a-12ef2756f634/volumes"
Sep 07 21:10:18.715003 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.714967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:10:18.718688 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.718665    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.721084 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.721064    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rnbnr\""
Sep 07 21:10:18.732418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.732398    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:10:18.756281 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.756246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.756423 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.756330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flst7\" (UniqueName: \"kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.857052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.857011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.857231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.857070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flst7\" (UniqueName: \"kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.857442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.857421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.872634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.872602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flst7\" (UniqueName: \"kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qdl55\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:18.907336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:18.907299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:19.006175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.006086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:19.028908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.028874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:19.139786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.139741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf" event={"ID":"cc7aa14a-a723-4db9-b897-d91a744969e5","Type":"ContainerStarted","Data":"a82679edf36aad69d4767d3315d3e7e6934a895f9113ef2d94790e24c398cc4e"}
Sep 07 21:10:19.140013 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.139809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf" event={"ID":"cc7aa14a-a723-4db9-b897-d91a744969e5","Type":"ContainerStarted","Data":"9006dab43e4255580e6dafc58243a17e39fcd022f3e9492c2c077fd63abfd391"}
Sep 07 21:10:19.140013 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.139841    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:19.159705 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.159651    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf" podStartSLOduration=2.159632783 podStartE2EDuration="2.159632783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:19.157762767 +0000 UTC m=+530.993888898" watchObservedRunningTime="2026-09-07 21:10:19.159632783 +0000 UTC m=+530.995758887"
Sep 07 21:10:19.305299 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:19.305267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:10:19.308205 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:10:19.308173    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71579ce8_aedd_4a9c_9c78_6fa7aa53b311.slice/crio-38939e973818f27e152fa8a6f35ef91521b280097bb79d83d3e025332fbf0701 WatchSource:0}: Error finding container 38939e973818f27e152fa8a6f35ef91521b280097bb79d83d3e025332fbf0701: Status 404 returned error can't find the container with id 38939e973818f27e152fa8a6f35ef91521b280097bb79d83d3e025332fbf0701
Sep 07 21:10:20.148762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:20.148725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" event={"ID":"71579ce8-aedd-4a9c-9c78-6fa7aa53b311","Type":"ContainerStarted","Data":"38939e973818f27e152fa8a6f35ef91521b280097bb79d83d3e025332fbf0701"}
Sep 07 21:10:23.169860 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:23.169816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" event={"ID":"71579ce8-aedd-4a9c-9c78-6fa7aa53b311","Type":"ContainerStarted","Data":"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"}
Sep 07 21:10:23.170318 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:23.169893    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:23.196356 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:23.196296    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" podStartSLOduration=1.630512854 podStartE2EDuration="5.196276207s" totalImagesPullingTime="3.565763353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:23.194862848 +0000 UTC m=+535.030988952" watchObservedRunningTime="2026-09-07 21:10:23.196276207 +0000 UTC m=+535.032402312"
Sep 07 21:10:25.443123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:25.443084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:25.546033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:25.545987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:30.151256 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:30.151224    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kffsf"
Sep 07 21:10:30.652279 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:30.652234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:30.752716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:30.752685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:31.052192 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:31.052153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:31.155480 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:31.155446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:31.253880 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:31.253846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:31.304814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:31.304738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:34.176890 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:34.176858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:10:38.294640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:38.294607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:38.399600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:38.399558    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:40.690997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:40.690969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:40.744667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:40.744626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:47.255470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:47.255431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:47.351369 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:47.351314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:50.518568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:50.518529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:50.671698 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:50.671658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:51.009381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:51.009332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:52.688682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:52.688644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:52.790750 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:52.790721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:52.850252 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:52.850211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:53.509757 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.509722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:53.597829 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.597788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:10:53.598459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.598435    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:10:53.601716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.601696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:10:53.604042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.604025    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9bpbs\""
Sep 07 21:10:53.608145 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.608124    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:10:53.764867 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.764782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f2k6\" (UniqueName: \"kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6\") pod \"authorino-c548b5d7d-gntrg\" (UID: \"90116b2f-c191-4d09-8820-5b4e13741f1a\") " pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:10:53.865859 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.865817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f2k6\" (UniqueName: \"kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6\") pod \"authorino-c548b5d7d-gntrg\" (UID: \"90116b2f-c191-4d09-8820-5b4e13741f1a\") " pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:10:53.874032 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.874010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f2k6\" (UniqueName: \"kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6\") pod \"authorino-c548b5d7d-gntrg\" (UID: \"90116b2f-c191-4d09-8820-5b4e13741f1a\") " pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:10:53.912039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:53.912012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:10:54.177438 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:54.177413    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:10:54.179247 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:10:54.179216    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90116b2f_c191_4d09_8820_5b4e13741f1a.slice/crio-3235dbd9de44ae2614bc05495793c8e1147600649dfa0d0bb9b0b342bbde8253 WatchSource:0}: Error finding container 3235dbd9de44ae2614bc05495793c8e1147600649dfa0d0bb9b0b342bbde8253: Status 404 returned error can't find the container with id 3235dbd9de44ae2614bc05495793c8e1147600649dfa0d0bb9b0b342bbde8253
Sep 07 21:10:54.318343 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:54.318307    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gntrg" event={"ID":"90116b2f-c191-4d09-8820-5b4e13741f1a","Type":"ContainerStarted","Data":"3235dbd9de44ae2614bc05495793c8e1147600649dfa0d0bb9b0b342bbde8253"}
Sep 07 21:10:56.332830 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:56.332737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gntrg" event={"ID":"90116b2f-c191-4d09-8820-5b4e13741f1a","Type":"ContainerStarted","Data":"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"}
Sep 07 21:10:56.347915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:10:56.347860    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-gntrg" podStartSLOduration=1.540193428 podStartE2EDuration="3.347844923s" totalImagesPullingTime="1.807651495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:10:56.346797172 +0000 UTC m=+568.182923278" watchObservedRunningTime="2026-09-07 21:10:56.347844923 +0000 UTC m=+568.183971028"
Sep 07 21:11:04.778282 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:04.778246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:04.833499 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:04.833452    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:08.791952 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:08.791901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:08.864295 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:08.864254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:09.277352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:09.277314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:21.212346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.212308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:21.615370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.615281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:21.784072 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.784040    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:11:21.787733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.787709    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:21.789888 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.789872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 21:11:21.794108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.794084    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:11:21.909915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.909882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:21.910092 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:21.909924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rppl\" (UniqueName: \"kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.011272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.011232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.011272 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.011275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rppl\" (UniqueName: \"kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.013805 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.013782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.019540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.019510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rppl\" (UniqueName: \"kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl\") pod \"authorino-7d665c478b-dvk42\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") " pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.097657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.097624    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:11:22.367169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.367089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:11:22.371057 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:11:22.371028    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a3011c1_da57_45a9_b545_3f9576c58ae7.slice/crio-2013bd803924fc8f669e11b6b2a278fc8b9026bf43bc75eec51ea7d3b7dfc853 WatchSource:0}: Error finding container 2013bd803924fc8f669e11b6b2a278fc8b9026bf43bc75eec51ea7d3b7dfc853: Status 404 returned error can't find the container with id 2013bd803924fc8f669e11b6b2a278fc8b9026bf43bc75eec51ea7d3b7dfc853
Sep 07 21:11:22.467978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:22.467936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d665c478b-dvk42" event={"ID":"2a3011c1-da57-45a9-b545-3f9576c58ae7","Type":"ContainerStarted","Data":"2013bd803924fc8f669e11b6b2a278fc8b9026bf43bc75eec51ea7d3b7dfc853"}
Sep 07 21:11:23.475023 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.474990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d665c478b-dvk42" event={"ID":"2a3011c1-da57-45a9-b545-3f9576c58ae7","Type":"ContainerStarted","Data":"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"}
Sep 07 21:11:23.491560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.491505    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d665c478b-dvk42" podStartSLOduration=1.819973712 podStartE2EDuration="2.491489368s" totalImagesPullingTime="671.515656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:11:23.48965698 +0000 UTC m=+595.325783089" watchObservedRunningTime="2026-09-07 21:11:23.491489368 +0000 UTC m=+595.327615472"
Sep 07 21:11:23.516373 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.516337    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:11:23.516532 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.516510    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-gntrg" podUID="90116b2f-c191-4d09-8820-5b4e13741f1a" containerName="authorino" containerID="cri-o://31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19" gracePeriod=30
Sep 07 21:11:23.769144 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.769117    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:11:23.827502 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.827462    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f2k6\" (UniqueName: \"kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6\") pod \"90116b2f-c191-4d09-8820-5b4e13741f1a\" (UID: \"90116b2f-c191-4d09-8820-5b4e13741f1a\") "
Sep 07 21:11:23.829496 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.829467    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6" (OuterVolumeSpecName: "kube-api-access-4f2k6") pod "90116b2f-c191-4d09-8820-5b4e13741f1a" (UID: "90116b2f-c191-4d09-8820-5b4e13741f1a"). InnerVolumeSpecName "kube-api-access-4f2k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:11:23.928670 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:23.928631    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f2k6\" (UniqueName: \"kubernetes.io/projected/90116b2f-c191-4d09-8820-5b4e13741f1a-kube-api-access-4f2k6\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:11:24.481589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.481549    2583 generic.go:356] "Generic (PLEG): container finished" podID="90116b2f-c191-4d09-8820-5b4e13741f1a" containerID="31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19" exitCode=0
Sep 07 21:11:24.481589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.481593    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-gntrg"
Sep 07 21:11:24.482103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.481630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gntrg" event={"ID":"90116b2f-c191-4d09-8820-5b4e13741f1a","Type":"ContainerDied","Data":"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"}
Sep 07 21:11:24.482103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.481674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-gntrg" event={"ID":"90116b2f-c191-4d09-8820-5b4e13741f1a","Type":"ContainerDied","Data":"3235dbd9de44ae2614bc05495793c8e1147600649dfa0d0bb9b0b342bbde8253"}
Sep 07 21:11:24.482103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.481691    2583 scope.go:117] "RemoveContainer" containerID="31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"
Sep 07 21:11:24.490106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.490088    2583 scope.go:117] "RemoveContainer" containerID="31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"
Sep 07 21:11:24.490369 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:11:24.490350    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19\": container with ID starting with 31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19 not found: ID does not exist" containerID="31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"
Sep 07 21:11:24.490428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.490383    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19"} err="failed to get container status \"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19\": rpc error: code = NotFound desc = could not find container \"31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19\": container with ID starting with 31ecb88244ea4f0f2b4ca8c14f756d0c85fbc2938d664e03a5cf67dded0dfb19 not found: ID does not exist"
Sep 07 21:11:24.501157 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.501107    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:11:24.503072 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.503054    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-gntrg"]
Sep 07 21:11:24.677058 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:24.677023    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90116b2f-c191-4d09-8820-5b4e13741f1a" path="/var/lib/kubelet/pods/90116b2f-c191-4d09-8820-5b4e13741f1a/volumes"
Sep 07 21:11:28.223095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.223058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:28.291319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.291259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:28.349178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.349143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:28.412826 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.412783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:28.627922 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.627839    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:11:28.631690 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.631668    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:11:28.880670 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:28.880578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:32.253906 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:32.253868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:11:32.359991 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:11:32.359932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:00.522118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:00.522078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:00.622632 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:00.622590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:03.817550 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:03.817505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:03.919991 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:03.919948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.246322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.246291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.344066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.344033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.444001 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.443950    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.543622 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.543522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.741422 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.741384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.831319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.831219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:05.859692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.859660    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"]
Sep 07 21:12:05.860154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.860137    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90116b2f-c191-4d09-8820-5b4e13741f1a" containerName="authorino"
Sep 07 21:12:05.860208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.860157    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="90116b2f-c191-4d09-8820-5b4e13741f1a" containerName="authorino"
Sep 07 21:12:05.860244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.860222    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="90116b2f-c191-4d09-8820-5b4e13741f1a" containerName="authorino"
Sep 07 21:12:05.863253 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.863234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:05.868157 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.868134    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 21:12:05.868335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.868139    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6hfqs\""
Sep 07 21:12:05.868455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.868169    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 21:12:05.868455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.868204    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 21:12:05.876306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.876283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"]
Sep 07 21:12:05.982838 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.982806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4792b5c5-a185-4041-950a-da4b5beb40ec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:05.983025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:05.982848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpv67\" (UniqueName: \"kubernetes.io/projected/4792b5c5-a185-4041-950a-da4b5beb40ec-kube-api-access-fpv67\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.084052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.083931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4792b5c5-a185-4041-950a-da4b5beb40ec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.084052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.084024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpv67\" (UniqueName: \"kubernetes.io/projected/4792b5c5-a185-4041-950a-da4b5beb40ec-kube-api-access-fpv67\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.084664 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.084641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4792b5c5-a185-4041-950a-da4b5beb40ec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.102135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.102096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpv67\" (UniqueName: \"kubernetes.io/projected/4792b5c5-a185-4041-950a-da4b5beb40ec-kube-api-access-fpv67\") pod \"payload-processing-5b54b7fbb7-gvzs6\" (UID: \"4792b5c5-a185-4041-950a-da4b5beb40ec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.175415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.175361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:06.461373 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.461337    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"]
Sep 07 21:12:06.463499 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:12:06.463463    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4792b5c5_a185_4041_950a_da4b5beb40ec.slice/crio-b383bfe9320be75c6df402424c7269fff26fcd57e6436232aeac9698b49aaa9b WatchSource:0}: Error finding container b383bfe9320be75c6df402424c7269fff26fcd57e6436232aeac9698b49aaa9b: Status 404 returned error can't find the container with id b383bfe9320be75c6df402424c7269fff26fcd57e6436232aeac9698b49aaa9b
Sep 07 21:12:06.690318 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:06.690283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6" event={"ID":"4792b5c5-a185-4041-950a-da4b5beb40ec","Type":"ContainerStarted","Data":"b383bfe9320be75c6df402424c7269fff26fcd57e6436232aeac9698b49aaa9b"}
Sep 07 21:12:08.703518 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:08.703481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6" event={"ID":"4792b5c5-a185-4041-950a-da4b5beb40ec","Type":"ContainerStarted","Data":"64675944a1e58087f859b5ad13e4fbdf1f2b29ee36637386345ecc956d703428"}
Sep 07 21:12:08.703901 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:08.703623    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:08.719786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:08.719729    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6" podStartSLOduration=2.011602279 podStartE2EDuration="3.719710321s" totalImagesPullingTime="1.708108042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:12:08.717850001 +0000 UTC m=+640.553976105" watchObservedRunningTime="2026-09-07 21:12:08.719710321 +0000 UTC m=+640.555836426"
Sep 07 21:12:15.762566 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:15.762519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:16.814968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:16.814917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:19.711091 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:19.711053    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gvzs6"
Sep 07 21:12:26.895488 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:26.895450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:40.348445 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.348411    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"]
Sep 07 21:12:40.352143 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.352124    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.355292 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.355270    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 21:12:40.355402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.355270    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rhzs9\""
Sep 07 21:12:40.355402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.355318    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 21:12:40.355402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.355367    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 07 21:12:40.364429 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.364406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"]
Sep 07 21:12:40.383169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.383141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:12:40.485238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.485360 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fln\" (UniqueName: \"kubernetes.io/projected/4b021339-6891-4b78-987b-6521a5f1516d-kube-api-access-j9fln\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.485360 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b021339-6891-4b78-987b-6521a5f1516d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.485437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.485437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.485437 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.485413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586412 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fln\" (UniqueName: \"kubernetes.io/projected/4b021339-6891-4b78-987b-6521a5f1516d-kube-api-access-j9fln\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b021339-6891-4b78-987b-6521a5f1516d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.586916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.587033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.586999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.588777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.588759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b021339-6891-4b78-987b-6521a5f1516d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.588979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.588929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b021339-6891-4b78-987b-6521a5f1516d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.594472 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.594447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fln\" (UniqueName: \"kubernetes.io/projected/4b021339-6891-4b78-987b-6521a5f1516d-kube-api-access-j9fln\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r2wv9\" (UID: \"4b021339-6891-4b78-987b-6521a5f1516d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.664870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.664840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:40.937641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.937613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"]
Sep 07 21:12:40.941349 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:12:40.941181    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b021339_6891_4b78_987b_6521a5f1516d.slice/crio-f65d6542ed2d976d565a7c0e0197116f9c85d980c9adb5bb371794510505f661 WatchSource:0}: Error finding container f65d6542ed2d976d565a7c0e0197116f9c85d980c9adb5bb371794510505f661: Status 404 returned error can't find the container with id f65d6542ed2d976d565a7c0e0197116f9c85d980c9adb5bb371794510505f661
Sep 07 21:12:40.942635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:40.942615    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:12:41.870972 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:41.870912    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9" event={"ID":"4b021339-6891-4b78-987b-6521a5f1516d","Type":"ContainerStarted","Data":"f65d6542ed2d976d565a7c0e0197116f9c85d980c9adb5bb371794510505f661"}
Sep 07 21:12:42.877043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:42.877003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9" event={"ID":"4b021339-6891-4b78-987b-6521a5f1516d","Type":"ContainerStarted","Data":"1e8a26b56cd7dff14aaa1f2f2ce7d7214a337159fd79a94d5345bbacd60b2948"}
Sep 07 21:12:42.894450 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:42.894401    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9" podStartSLOduration=1.772012693 podStartE2EDuration="2.894387858s" totalImagesPullingTime="1.122375165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:12:42.89201077 +0000 UTC m=+674.728136875" watchObservedRunningTime="2026-09-07 21:12:42.894387858 +0000 UTC m=+674.730513962"
Sep 07 21:12:50.665223 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:50.665176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:50.665619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:50.665304    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:50.677872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:50.677848    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:50.925020 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:50.924933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r2wv9"
Sep 07 21:12:51.199584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:12:51.199496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:13:05.085184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:05.085145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:13:12.680964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:12.680902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:13:30.556829 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.556753    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"]
Sep 07 21:13:30.560276 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.560256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.562544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.562523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 07 21:13:30.570556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.570537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"]
Sep 07 21:13:30.659536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.659503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:13:30.714489 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.714648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.714648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.714723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6896a76-0334-4b67-9d84-a23d57a31e70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.714723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nv8r\" (UniqueName: \"kubernetes.io/projected/f6896a76-0334-4b67-9d84-a23d57a31e70-kube-api-access-4nv8r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.714787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.714726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6896a76-0334-4b67-9d84-a23d57a31e70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nv8r\" (UniqueName: \"kubernetes.io/projected/f6896a76-0334-4b67-9d84-a23d57a31e70-kube-api-access-4nv8r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816611 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.816725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.816700    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.818357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.818332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6896a76-0334-4b67-9d84-a23d57a31e70-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.818620 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.818596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6896a76-0334-4b67-9d84-a23d57a31e70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.823884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.823863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nv8r\" (UniqueName: \"kubernetes.io/projected/f6896a76-0334-4b67-9d84-a23d57a31e70-kube-api-access-4nv8r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wfg6\" (UID: \"f6896a76-0334-4b67-9d84-a23d57a31e70\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:30.869767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:30.869745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:31.144891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:31.144863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"]
Sep 07 21:13:31.145950 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:13:31.145915    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6896a76_0334_4b67_9d84_a23d57a31e70.slice/crio-e674124e5332237508795d16a1cea86a7d9b06b4c8ff8f3590ebda80e9cf5470 WatchSource:0}: Error finding container e674124e5332237508795d16a1cea86a7d9b06b4c8ff8f3590ebda80e9cf5470: Status 404 returned error can't find the container with id e674124e5332237508795d16a1cea86a7d9b06b4c8ff8f3590ebda80e9cf5470
Sep 07 21:13:32.118534 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:32.118494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6" event={"ID":"f6896a76-0334-4b67-9d84-a23d57a31e70","Type":"ContainerStarted","Data":"fb2e7a19c34fed10fdde1ca2f1197d7f7da42c17462a5fb745185c36c17f7f76"}
Sep 07 21:13:32.118931 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:32.118564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6" event={"ID":"f6896a76-0334-4b67-9d84-a23d57a31e70","Type":"ContainerStarted","Data":"e674124e5332237508795d16a1cea86a7d9b06b4c8ff8f3590ebda80e9cf5470"}
Sep 07 21:13:32.134655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:32.134601    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6" podStartSLOduration=1.958778227 podStartE2EDuration="2.134584506s" totalImagesPullingTime="175.806279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:13:32.133572951 +0000 UTC m=+723.969699050" watchObservedRunningTime="2026-09-07 21:13:32.134584506 +0000 UTC m=+723.970710611"
Sep 07 21:13:40.870606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:40.870574    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:40.871168 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:40.870636    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:40.882910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:40.882888    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:41.182902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:41.182873    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wfg6"
Sep 07 21:13:41.578442 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:13:41.578358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:14:08.151498 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:08.151462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:14:58.678738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:58.678702    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:14:58.679321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:58.678895    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d665c478b-dvk42" podUID="2a3011c1-da57-45a9-b545-3f9576c58ae7" containerName="authorino" containerID="cri-o://15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d" gracePeriod=30
Sep 07 21:14:58.939627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:58.939559    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:14:59.106759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.106710    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rppl\" (UniqueName: \"kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl\") pod \"2a3011c1-da57-45a9-b545-3f9576c58ae7\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") "
Sep 07 21:14:59.106989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.106864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert\") pod \"2a3011c1-da57-45a9-b545-3f9576c58ae7\" (UID: \"2a3011c1-da57-45a9-b545-3f9576c58ae7\") "
Sep 07 21:14:59.109073 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.109041    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl" (OuterVolumeSpecName: "kube-api-access-7rppl") pod "2a3011c1-da57-45a9-b545-3f9576c58ae7" (UID: "2a3011c1-da57-45a9-b545-3f9576c58ae7"). InnerVolumeSpecName "kube-api-access-7rppl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:14:59.118129 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.118088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2a3011c1-da57-45a9-b545-3f9576c58ae7" (UID: "2a3011c1-da57-45a9-b545-3f9576c58ae7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:14:59.167360 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.167312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:14:59.208656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.208567    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a3011c1-da57-45a9-b545-3f9576c58ae7-tls-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:14:59.208656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.208598    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rppl\" (UniqueName: \"kubernetes.io/projected/2a3011c1-da57-45a9-b545-3f9576c58ae7-kube-api-access-7rppl\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:14:59.264092 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.264052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:14:59.553825 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.553732    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a3011c1-da57-45a9-b545-3f9576c58ae7" containerID="15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d" exitCode=0
Sep 07 21:14:59.553825 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.553777    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d665c478b-dvk42"
Sep 07 21:14:59.554039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.553822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d665c478b-dvk42" event={"ID":"2a3011c1-da57-45a9-b545-3f9576c58ae7","Type":"ContainerDied","Data":"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"}
Sep 07 21:14:59.554039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.553865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d665c478b-dvk42" event={"ID":"2a3011c1-da57-45a9-b545-3f9576c58ae7","Type":"ContainerDied","Data":"2013bd803924fc8f669e11b6b2a278fc8b9026bf43bc75eec51ea7d3b7dfc853"}
Sep 07 21:14:59.554039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.553888    2583 scope.go:117] "RemoveContainer" containerID="15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"
Sep 07 21:14:59.563815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.563791    2583 scope.go:117] "RemoveContainer" containerID="15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"
Sep 07 21:14:59.564125 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:14:59.564104    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d\": container with ID starting with 15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d not found: ID does not exist" containerID="15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"
Sep 07 21:14:59.564219 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.564132    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d"} err="failed to get container status \"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d\": rpc error: code = NotFound desc = could not find container \"15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d\": container with ID starting with 15df3d124bb3cd92e674ecad9a7241493150cd183fc9a91aa923902039dc3e2d not found: ID does not exist"
Sep 07 21:14:59.576631 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.576604    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:14:59.581724 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:14:59.581703    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d665c478b-dvk42"]
Sep 07 21:15:00.141961 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.141910    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"]
Sep 07 21:15:00.142365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.142350    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3011c1-da57-45a9-b545-3f9576c58ae7" containerName="authorino"
Sep 07 21:15:00.142405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.142367    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3011c1-da57-45a9-b545-3f9576c58ae7" containerName="authorino"
Sep 07 21:15:00.142453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.142446    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a3011c1-da57-45a9-b545-3f9576c58ae7" containerName="authorino"
Sep 07 21:15:00.146859 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.146836    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"
Sep 07 21:15:00.148881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.148857    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:15:00.152142 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.152117    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"]
Sep 07 21:15:00.158771 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.158746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"
Sep 07 21:15:00.281154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.281117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:00.380895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.380858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:00.434651 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.434618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"]
Sep 07 21:15:00.437489 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:00.437448    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292a096e_69c5_4e88_9887_b03f035f1334.slice/crio-e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588 WatchSource:0}: Error finding container e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588: Status 404 returned error can't find the container with id e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588
Sep 07 21:15:00.561400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.561357    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8" event={"ID":"292a096e-69c5-4e88-9887-b03f035f1334","Type":"ContainerStarted","Data":"e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588"}
Sep 07 21:15:00.678315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:00.678278    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3011c1-da57-45a9-b545-3f9576c58ae7" path="/var/lib/kubelet/pods/2a3011c1-da57-45a9-b545-3f9576c58ae7/volumes"
Sep 07 21:15:01.480816 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:01.480777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:01.581210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:01.581170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:03.582904 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:03.582865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8" event={"ID":"292a096e-69c5-4e88-9887-b03f035f1334","Type":"ContainerStarted","Data":"5cdbb900e2e92579123ee67d46a0757761bb61d5c09ca2105c8e54b2003d5981"}
Sep 07 21:15:03.597533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:03.597481    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8" podStartSLOduration=1.276079603 podStartE2EDuration="3.597462989s" totalImagesPullingTime="2.321383386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:03.595755505 +0000 UTC m=+815.431881613" watchObservedRunningTime="2026-09-07 21:15:03.597462989 +0000 UTC m=+815.433589097"
Sep 07 21:15:04.590341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:04.590297    2583 generic.go:356] "Generic (PLEG): container finished" podID="292a096e-69c5-4e88-9887-b03f035f1334" containerID="5cdbb900e2e92579123ee67d46a0757761bb61d5c09ca2105c8e54b2003d5981" exitCode=0
Sep 07 21:15:04.590847 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:04.590361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8" event={"ID":"292a096e-69c5-4e88-9887-b03f035f1334","Type":"ContainerDied","Data":"5cdbb900e2e92579123ee67d46a0757761bb61d5c09ca2105c8e54b2003d5981"}
Sep 07 21:15:05.734074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:05.734046    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"
Sep 07 21:15:06.602308 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:06.602269    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8"
Sep 07 21:15:06.602308 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:06.602300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813595-z49b8" event={"ID":"292a096e-69c5-4e88-9887-b03f035f1334","Type":"ContainerDied","Data":"e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588"}
Sep 07 21:15:06.602582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:06.602348    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3d0925d8437b2b3dcadca6901d052c05b4487b11ecf99bb4164cad324088588"
Sep 07 21:15:15.869310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:15.869272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:15.970206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:15.970162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:16.201544 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:16.201501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:16.388483 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:16.388439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:17.168556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:17.168492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:17.275881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:17.275845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:17.604669 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:17.604555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:19.146971 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:19.146926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:19.238906 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:19.238871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.388538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.388503    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:15:20.388935 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.388920    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292a096e-69c5-4e88-9887-b03f035f1334" containerName="cleanup"
Sep 07 21:15:20.388935 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.388933    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="292a096e-69c5-4e88-9887-b03f035f1334" containerName="cleanup"
Sep 07 21:15:20.389049 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.389037    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="292a096e-69c5-4e88-9887-b03f035f1334" containerName="cleanup"
Sep 07 21:15:20.392324 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.392298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.394549 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.394525    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:15:20.395556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.395506    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 21:15:20.395556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.395506    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-06f0f6-serving-cert\""
Sep 07 21:15:20.395556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.395546    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nj5g\""
Sep 07 21:15:20.395556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.395506    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 21:15:20.406186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.406149    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:15:20.437564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.437518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.514396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.514352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.514396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.514402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.514641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.514424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q792p\" (UniqueName: \"kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.514641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.514496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.536855 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.536826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.615444 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.615405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.615655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.615451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.615655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.615472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q792p\" (UniqueName: \"kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.615655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.615489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.615655 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:15:20.615622    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-serving-cert: secret "maas-api-e2e-inf-a-06f0f6-serving-cert" not found
Sep 07 21:15:20.615844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:15:20.615698    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls podName:42192f85-95fe-4851-9221-ade5e8f428e4 nodeName:}" failed. No retries permitted until 2026-09-07 21:15:21.115677964 +0000 UTC m=+832.951804048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls") pod "maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" (UID: "42192f85-95fe-4851-9221-ade5e8f428e4") : secret "maas-api-e2e-inf-a-06f0f6-serving-cert" not found
Sep 07 21:15:20.616176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.616149    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.618026 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.618007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.626100 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.626051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q792p\" (UniqueName: \"kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:20.674666 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.674624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.883091 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.883054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.985286 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.985180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:20.992587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.992555    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:15:20.996127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.996108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:20.998324 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.998295    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-06f0f6-dockercfg-pm4d9\""
Sep 07 21:15:20.998324 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:20.998295    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-06f0f6\""
Sep 07 21:15:21.006433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.006403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:15:21.121879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.121839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:21.122075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.121894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.122075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.121917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5wm\" (UniqueName: \"kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.124896 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.124859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:21.223210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.223174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.223210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.223215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5wm\" (UniqueName: \"kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.223911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.223890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.231254 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.231229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5wm\" (UniqueName: \"kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm\") pod \"payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.309379 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.309285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:21.310334 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.310311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:21.585829 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.585735    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:15:21.590128 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:21.590092    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42192f85_95fe_4851_9221_ade5e8f428e4.slice/crio-d00df6dbbed793d83e1d1b397aaa326fea60e4f9f869e52bf364611e73461c9b WatchSource:0}: Error finding container d00df6dbbed793d83e1d1b397aaa326fea60e4f9f869e52bf364611e73461c9b: Status 404 returned error can't find the container with id d00df6dbbed793d83e1d1b397aaa326fea60e4f9f869e52bf364611e73461c9b
Sep 07 21:15:21.598504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.598470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:15:21.600374 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:21.600343    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d46c27d_9dff_4e7f_a17d_af936fd4ef8c.slice/crio-9ce2661244e8fc58123f805e82ece71ed42bdcb56db4e57413fea8eeb09fabe7 WatchSource:0}: Error finding container 9ce2661244e8fc58123f805e82ece71ed42bdcb56db4e57413fea8eeb09fabe7: Status 404 returned error can't find the container with id 9ce2661244e8fc58123f805e82ece71ed42bdcb56db4e57413fea8eeb09fabe7
Sep 07 21:15:21.676206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.676178    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" event={"ID":"42192f85-95fe-4851-9221-ade5e8f428e4","Type":"ContainerStarted","Data":"d00df6dbbed793d83e1d1b397aaa326fea60e4f9f869e52bf364611e73461c9b"}
Sep 07 21:15:21.677766 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:21.677742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" event={"ID":"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c","Type":"ContainerStarted","Data":"9ce2661244e8fc58123f805e82ece71ed42bdcb56db4e57413fea8eeb09fabe7"}
Sep 07 21:15:22.687253 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:22.687211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" event={"ID":"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c","Type":"ContainerStarted","Data":"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"}
Sep 07 21:15:22.687738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:22.687373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:22.708036 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:22.707781    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" podStartSLOduration=2.707758532 podStartE2EDuration="2.707758532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:22.704792208 +0000 UTC m=+834.540918314" watchObservedRunningTime="2026-09-07 21:15:22.707758532 +0000 UTC m=+834.543884638"
Sep 07 21:15:23.601221 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:23.601166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:23.699073 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:23.698988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:23.818812 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:23.818773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:24.095831 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:24.095792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:24.331676 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:24.331573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:24.699218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:24.699177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" event={"ID":"42192f85-95fe-4851-9221-ade5e8f428e4","Type":"ContainerStarted","Data":"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"}
Sep 07 21:15:24.699716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:24.699324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:24.717771 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:24.717713    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" podStartSLOduration=2.271605456 podStartE2EDuration="4.717697344s" totalImagesPullingTime="2.446091888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:24.715869314 +0000 UTC m=+836.551995419" watchObservedRunningTime="2026-09-07 21:15:24.717697344 +0000 UTC m=+836.553823449"
Sep 07 21:15:26.668248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:26.668184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:26.766907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:26.766860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:27.502573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.502535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:27.755974 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.755877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:15:27.760241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.760212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.762502 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.762473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 21:15:27.762653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.762530    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-9e1e8d-openshift-default-dockercfg-cblnj\""
Sep 07 21:15:27.770921 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.770896    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:15:27.805558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.805518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:27.806274 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.806249    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:15:27.809743 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.809719    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.811838 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.811817    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-28fa6ddd-serving-cert\""
Sep 07 21:15:27.818241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.818214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:15:27.890657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.890657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.890883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.890883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.890883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.890883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.891045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzm5c\" (UniqueName: \"kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.891045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.891045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.890983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.891045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.891017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.891045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.891037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.891205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.891054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kms9d\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.891205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.891153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.895115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.895089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:27.992181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992382 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992382 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzm5c\" (UniqueName: \"kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.992382 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.992610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.992653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kms9d\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992863 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.992918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.992918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.993048 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.992962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.993379 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.993353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.993547 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.993361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.993693 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.993609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.993820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.993627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.993988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.993812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.995116 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.995088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.995402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.995351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:27.995582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.995563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:27.995664 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.995633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:27.995895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:27.995874    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:28.001239 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.001211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzm5c\" (UniqueName: \"kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c\") pod \"maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:28.001933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.001910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kms9d\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:28.002166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.002144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token\") pod \"e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") " pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:28.073462 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.073368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:28.095702 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.095666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:28.123631 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.123583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:28.196841 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.196795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:28.343927 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.343835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:28.358925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.358899    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:15:28.360985 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:28.360922    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b497ea_c4a4_4138_9579_627e836fa12f.slice/crio-b344beea9dd2265d9baf7d1e89164bbad9d65f6c38c8e1954d54565936e2db5c WatchSource:0}: Error finding container b344beea9dd2265d9baf7d1e89164bbad9d65f6c38c8e1954d54565936e2db5c: Status 404 returned error can't find the container with id b344beea9dd2265d9baf7d1e89164bbad9d65f6c38c8e1954d54565936e2db5c
Sep 07 21:15:28.410140 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.410114    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:15:28.413115 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:28.413085    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5afa9fd_fdb1_4434_a6a5_1e62c4e2af59.slice/crio-ab99beaaad2b84fdb0eca79e150e29d88ed6388f6aa4a90485382937d1dc35f8 WatchSource:0}: Error finding container ab99beaaad2b84fdb0eca79e150e29d88ed6388f6aa4a90485382937d1dc35f8: Status 404 returned error can't find the container with id ab99beaaad2b84fdb0eca79e150e29d88ed6388f6aa4a90485382937d1dc35f8
Sep 07 21:15:28.415027 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.414992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:28.526162 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.525266    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:15:28.532218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.532181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:15:28.532353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.532273    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.534618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.534589    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-28fa6ddd\""
Sep 07 21:15:28.534773 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.534600    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-28fa6ddd-dockercfg-hntrg\""
Sep 07 21:15:28.600533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.600447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbgnc\" (UniqueName: \"kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.600533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.600529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.701146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.701104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.701299 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.701264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbgnc\" (UniqueName: \"kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.703386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.703353    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-28fa6ddd\""
Sep 07 21:15:28.708554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.708524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbgnc\" (UniqueName: \"kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.712742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.712717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:28.722340 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.722303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" event={"ID":"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59","Type":"ContainerStarted","Data":"ab99beaaad2b84fdb0eca79e150e29d88ed6388f6aa4a90485382937d1dc35f8"}
Sep 07 21:15:28.723649 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.723619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerStarted","Data":"b344beea9dd2265d9baf7d1e89164bbad9d65f6c38c8e1954d54565936e2db5c"}
Sep 07 21:15:28.847311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.847287    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-28fa6ddd-dockercfg-hntrg\""
Sep 07 21:15:28.854867 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:28.854799    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:29.131357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.131259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:15:29.134421 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:29.134387    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c235c90_a9a0_4f8b_817c_b0c7a57a6563.slice/crio-eb88da4bb55ab5eac0ead73b502b9162730a14f785245d17b1fc3fa739d1b1d2 WatchSource:0}: Error finding container eb88da4bb55ab5eac0ead73b502b9162730a14f785245d17b1fc3fa739d1b1d2: Status 404 returned error can't find the container with id eb88da4bb55ab5eac0ead73b502b9162730a14f785245d17b1fc3fa739d1b1d2
Sep 07 21:15:29.731415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.731375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" event={"ID":"9c235c90-a9a0-4f8b-817c-b0c7a57a6563","Type":"ContainerStarted","Data":"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"}
Sep 07 21:15:29.731586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.731446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" event={"ID":"9c235c90-a9a0-4f8b-817c-b0c7a57a6563","Type":"ContainerStarted","Data":"eb88da4bb55ab5eac0ead73b502b9162730a14f785245d17b1fc3fa739d1b1d2"}
Sep 07 21:15:29.731586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.731573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:29.733236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.733207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" event={"ID":"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59","Type":"ContainerStarted","Data":"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"}
Sep 07 21:15:29.733347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.733284    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:29.747473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.747413    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" podStartSLOduration=1.747393249 podStartE2EDuration="1.747393249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:29.745135099 +0000 UTC m=+841.581261205" watchObservedRunningTime="2026-09-07 21:15:29.747393249 +0000 UTC m=+841.583519359"
Sep 07 21:15:29.763039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:29.762985    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" podStartSLOduration=2.380450707 podStartE2EDuration="2.762969302s" totalImagesPullingTime="382.518595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:29.760680775 +0000 UTC m=+841.596806882" watchObservedRunningTime="2026-09-07 21:15:29.762969302 +0000 UTC m=+841.599095406"
Sep 07 21:15:30.712582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:30.712546    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:15:31.212835 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:31.212784    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:31.212964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:31.212885    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:31.212964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:31.212923    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:31.754569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:31.754528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerStarted","Data":"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"}
Sep 07 21:15:31.774468 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:31.774417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podStartSLOduration=1.925721274 podStartE2EDuration="4.774402443s" totalImagesPullingTime="2.848681169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:31.774019281 +0000 UTC m=+843.610145387" watchObservedRunningTime="2026-09-07 21:15:31.774402443 +0000 UTC m=+843.610528548"
Sep 07 21:15:32.074432 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:32.074323    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:32.079761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:32.079728    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:32.760566 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:32.760529    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:32.761587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:32.761569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:33.695433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:33.695402    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:15:33.768462 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:33.768433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:33.867551 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:33.867510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:34.981127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:34.981082    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:15:34.990016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:34.989986    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:34.992655 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:34.992336    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-9e1e8d-serving-cert\""
Sep 07 21:15:34.995794 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:34.995765    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:15:35.020749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.020702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:35.120524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.120480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:35.164594 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.164555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.164776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.164676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7hg\" (UniqueName: \"kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.164776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.164714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.164776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.164738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.265914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.265829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7hg\" (UniqueName: \"kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.265914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.265878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.266229 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.266003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.266229 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.266137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.266562 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.266533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.268647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.268614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.268745 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.268668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.273205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.273185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7hg\" (UniqueName: \"kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg\") pod \"maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.284993 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.284958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:35.308824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.308786    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:35.502255 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.502213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:35.581342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.581251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:15:35.583905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.583872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:35.584524 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:35.584502    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffc9f66_1c46_4c7e_b35b_b4e28d0c0471.slice/crio-cfb690a4dbdf6b71b0b8e52857a37a0feb0cc7012c0cbdc30cc3f9414b8fe1da WatchSource:0}: Error finding container cfb690a4dbdf6b71b0b8e52857a37a0feb0cc7012c0cbdc30cc3f9414b8fe1da: Status 404 returned error can't find the container with id cfb690a4dbdf6b71b0b8e52857a37a0feb0cc7012c0cbdc30cc3f9414b8fe1da
Sep 07 21:15:35.615610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.615577    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:15:35.620445 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.620423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.622601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.622579    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-9e1e8d\""
Sep 07 21:15:35.622737 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.622605    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-9e1e8d-dockercfg-8qvz4\""
Sep 07 21:15:35.630500 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.630474    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:15:35.746028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.746001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:15:35.771994 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.771955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f6lx\" (UniqueName: \"kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.772198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.772040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.779963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.779907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" event={"ID":"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471","Type":"ContainerStarted","Data":"cfb690a4dbdf6b71b0b8e52857a37a0feb0cc7012c0cbdc30cc3f9414b8fe1da"}
Sep 07 21:15:35.872854 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.872754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f6lx\" (UniqueName: \"kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.873055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.872981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.873658 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.873637    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.879954 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.879915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f6lx\" (UniqueName: \"kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx\") pod \"payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:35.932771 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:35.932743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:36.215269 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.215243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:15:36.217195 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:36.217171    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd4c47b_7e24_4b8a_982b_6876b341e17d.slice/crio-58f10bcbd6638a9565c84f26aa65ae4bd30bd3abf8afb09e026429d0f7120787 WatchSource:0}: Error finding container 58f10bcbd6638a9565c84f26aa65ae4bd30bd3abf8afb09e026429d0f7120787: Status 404 returned error can't find the container with id 58f10bcbd6638a9565c84f26aa65ae4bd30bd3abf8afb09e026429d0f7120787
Sep 07 21:15:36.387005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.386935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:36.537639 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.537547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:36.681710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.681669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:36.786663 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.786622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" event={"ID":"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471","Type":"ContainerStarted","Data":"64e6c8dfea86338bec9f1d32b4818bee98ba628b6b6cdef83116dcd0cd1ce877"}
Sep 07 21:15:36.786887 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.786704    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:36.788397 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.788326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" event={"ID":"2cd4c47b-7e24-4b8a-982b-6876b341e17d","Type":"ContainerStarted","Data":"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"}
Sep 07 21:15:36.788397 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.788380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" event={"ID":"2cd4c47b-7e24-4b8a-982b-6876b341e17d","Type":"ContainerStarted","Data":"58f10bcbd6638a9565c84f26aa65ae4bd30bd3abf8afb09e026429d0f7120787"}
Sep 07 21:15:36.788533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.788408    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:36.805108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.805059    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" podStartSLOduration=2.483023348 podStartE2EDuration="2.805043828s" totalImagesPullingTime="322.02048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:36.802432259 +0000 UTC m=+848.638558364" watchObservedRunningTime="2026-09-07 21:15:36.805043828 +0000 UTC m=+848.641169933"
Sep 07 21:15:36.824260 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.824209    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" podStartSLOduration=1.824192664 podStartE2EDuration="1.824192664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:36.822050758 +0000 UTC m=+848.658176865" watchObservedRunningTime="2026-09-07 21:15:36.824192664 +0000 UTC m=+848.660318769"
Sep 07 21:15:36.924874 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:36.924834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:39.392305 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:39.392272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:40.742319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:40.742291    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:15:40.989202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:40.989167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:42.309217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:42.309170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:42.799622 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:42.799583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:15:44.050174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:44.050130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:44.382512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:44.382418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:44.674540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:44.674497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:45.599206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:45.599171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:47.418963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:47.418905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:47.516056 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:47.516017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:47.616933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:47.616900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:47.796053 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:47.795957    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:15:48.944182 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:48.944142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:49.738524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:49.738485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:49.893636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:49.893602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.064606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.064576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.166798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.166749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.568217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.568167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.668462 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.668428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.697504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.697466    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:15:51.702579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.702538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.704124 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.704097    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:15:51.704915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.704895    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-3102b2\""
Sep 07 21:15:51.707636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.707613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.710820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.710798    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-3102b2-dockercfg-rm6k2\""
Sep 07 21:15:51.711856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.711788    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:15:51.719187 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.719153    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:15:51.727230 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.727197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.727394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.727251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdkb\" (UniqueName: \"kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.727394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.727295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.727394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.727374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8kp7\" (UniqueName: \"kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.755849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.755811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:51.828142 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.828053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.828320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.828141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8kp7\" (UniqueName: \"kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.828320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.828239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.828320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.828275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdkb\" (UniqueName: \"kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.828911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.828889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.829159 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.829134    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:51.839270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.839233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdkb\" (UniqueName: \"kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb\") pod \"payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:51.840174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:51.840148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8kp7\" (UniqueName: \"kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7\") pod \"payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:52.021355 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.021296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:52.029828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.029798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:52.306227 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.306196    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:15:52.308874 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:52.308839    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0a042a_9f0d_46b9_a5d9_826bc353974d.slice/crio-7841cb81b48c6024fcf8b41b5f970c6e63b2993a36b71b5bb912f81d82094832 WatchSource:0}: Error finding container 7841cb81b48c6024fcf8b41b5f970c6e63b2993a36b71b5bb912f81d82094832: Status 404 returned error can't find the container with id 7841cb81b48c6024fcf8b41b5f970c6e63b2993a36b71b5bb912f81d82094832
Sep 07 21:15:52.319016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.318897    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:15:52.325299 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:15:52.325269    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f6bbfe_192a_4c98_9b83_48cf6d8b185d.slice/crio-5376b3e9328fb37fd3b1ef0f335242c6d222c89a33209506c578729dc6839864 WatchSource:0}: Error finding container 5376b3e9328fb37fd3b1ef0f335242c6d222c89a33209506c578729dc6839864: Status 404 returned error can't find the container with id 5376b3e9328fb37fd3b1ef0f335242c6d222c89a33209506c578729dc6839864
Sep 07 21:15:52.741704 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.741645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:52.895603 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.895552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" event={"ID":"ca0a042a-9f0d-46b9-a5d9-826bc353974d","Type":"ContainerStarted","Data":"de4c84fa681348e2dcb5b09e08ff5aa58420cad24697f047c377401cd35fc88e"}
Sep 07 21:15:52.895785 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.895632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:15:52.895785 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.895657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" event={"ID":"ca0a042a-9f0d-46b9-a5d9-826bc353974d","Type":"ContainerStarted","Data":"7841cb81b48c6024fcf8b41b5f970c6e63b2993a36b71b5bb912f81d82094832"}
Sep 07 21:15:52.897405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.897372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" event={"ID":"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d","Type":"ContainerStarted","Data":"183ae8b37c635e4662afe27166aa5b33a42ad331fe19ff4810773c494d31feb5"}
Sep 07 21:15:52.897539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.897426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" event={"ID":"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d","Type":"ContainerStarted","Data":"5376b3e9328fb37fd3b1ef0f335242c6d222c89a33209506c578729dc6839864"}
Sep 07 21:15:52.897988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.897969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:15:52.913426 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.913356    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" podStartSLOduration=1.9133344110000001 podStartE2EDuration="1.913334411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:52.910615745 +0000 UTC m=+864.746741857" watchObservedRunningTime="2026-09-07 21:15:52.913334411 +0000 UTC m=+864.749460521"
Sep 07 21:15:52.929085 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:52.929018    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" podStartSLOduration=1.928993761 podStartE2EDuration="1.928993761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:15:52.925092038 +0000 UTC m=+864.761218149" watchObservedRunningTime="2026-09-07 21:15:52.928993761 +0000 UTC m=+864.765119867"
Sep 07 21:15:53.802672 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:53.802628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:53.913214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:53.913172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:54.016245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.016195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:54.163180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.163141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:54.914953 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.914907    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerID="5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2" exitCode=0
Sep 07 21:15:54.915427 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.914986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerDied","Data":"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"}
Sep 07 21:15:54.915427 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.915416    2583 scope.go:117] "RemoveContainer" containerID="5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"
Sep 07 21:15:54.917420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.917386    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:54.917539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.917477    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:54.917539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:54.917527    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:15:55.899975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:55.899919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:55.923843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:55.923802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerStarted","Data":"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"}
Sep 07 21:15:56.074453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:56.074409    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:15:56.075300 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:56.075273    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:15:56.075384 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:56.075329    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:15:57.074516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:57.074476    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:15:57.075022 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:57.074535    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:15:58.074351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:58.074307    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:15:58.074570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:58.074371    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:15:58.688186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:58.688136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:15:59.074106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:59.074014    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:15:59.074106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:15:59.074071    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:16:00.074351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:00.074306    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:16:00.074723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:00.074364    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:16:00.147362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:00.147317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:00.249590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:00.249554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:00.850294 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:00.850245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:01.073737 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:01.073701    2583 patch_prober.go:28] interesting pod/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 07 21:16:01.073994 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:01.073758    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 07 21:16:02.078301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:02.078264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:16:02.078697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:02.078667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:16:02.079399 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:02.079376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:16:03.909131 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:03.909098    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:16:04.917964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:04.917912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:16:08.027102 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.027059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:08.573112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.573071    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:16:08.573324 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.573297    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" podUID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" containerName="maas-api" containerID="cri-o://00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222" gracePeriod=30
Sep 07 21:16:08.595838 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.595783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:08.630661 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.630621    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:16:08.631063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.630915    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" podUID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" containerName="payload-pre-processing" containerID="cri-o://2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc" gracePeriod=30
Sep 07 21:16:08.663238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.663212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:08.763234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.763195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:08.842845 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.842734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:08.903235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.903203    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:16:08.943465 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.943436    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:16:08.948703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:08.948671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:09.008335 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.008291    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" containerID="00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222" exitCode=0
Sep 07 21:16:09.008524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.008355    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"
Sep 07 21:16:09.008524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.008390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" event={"ID":"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59","Type":"ContainerDied","Data":"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"}
Sep 07 21:16:09.008524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.008488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp" event={"ID":"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59","Type":"ContainerDied","Data":"ab99beaaad2b84fdb0eca79e150e29d88ed6388f6aa4a90485382937d1dc35f8"}
Sep 07 21:16:09.008524 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.008523    2583 scope.go:117] "RemoveContainer" containerID="00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"
Sep 07 21:16:09.010548 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.010519    2583 generic.go:356] "Generic (PLEG): container finished" podID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" containerID="2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc" exitCode=0
Sep 07 21:16:09.010685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.010557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" event={"ID":"9c235c90-a9a0-4f8b-817c-b0c7a57a6563","Type":"ContainerDied","Data":"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"}
Sep 07 21:16:09.010685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.010564    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"
Sep 07 21:16:09.010685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.010592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8" event={"ID":"9c235c90-a9a0-4f8b-817c-b0c7a57a6563","Type":"ContainerDied","Data":"eb88da4bb55ab5eac0ead73b502b9162730a14f785245d17b1fc3fa739d1b1d2"}
Sep 07 21:16:09.018264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018244    2583 scope.go:117] "RemoveContainer" containerID="00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"
Sep 07 21:16:09.018494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbgnc\" (UniqueName: \"kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc\") pod \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") "
Sep 07 21:16:09.018568 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:16:09.018542    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222\": container with ID starting with 00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222 not found: ID does not exist" containerID="00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"
Sep 07 21:16:09.018608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume\") pod \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\" (UID: \"9c235c90-a9a0-4f8b-817c-b0c7a57a6563\") "
Sep 07 21:16:09.018649 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018574    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222"} err="failed to get container status \"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222\": rpc error: code = NotFound desc = could not find container \"00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222\": container with ID starting with 00bb82207baf097b27a185a9fe32c5d0c149d9b94dfa6523c0de663ddedb1222 not found: ID does not exist"
Sep 07 21:16:09.018649 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018623    2583 scope.go:117] "RemoveContainer" containerID="2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"
Sep 07 21:16:09.018879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzm5c\" (UniqueName: \"kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c\") pod \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") "
Sep 07 21:16:09.018879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018747    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls\") pod \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") "
Sep 07 21:16:09.018879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018784    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca\") pod \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") "
Sep 07 21:16:09.018879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.018812    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs\") pod \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\" (UID: \"d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59\") "
Sep 07 21:16:09.019245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.019203    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" (UID: "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:16:09.019584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.019491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c235c90-a9a0-4f8b-817c-b0c7a57a6563" (UID: "9c235c90-a9a0-4f8b-817c-b0c7a57a6563"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:16:09.021245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.021216    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" (UID: "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:16:09.021325 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.021259    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc" (OuterVolumeSpecName: "kube-api-access-fbgnc") pod "9c235c90-a9a0-4f8b-817c-b0c7a57a6563" (UID: "9c235c90-a9a0-4f8b-817c-b0c7a57a6563"). InnerVolumeSpecName "kube-api-access-fbgnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:09.021432 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.021413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c" (OuterVolumeSpecName: "kube-api-access-hzm5c") pod "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" (UID: "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59"). InnerVolumeSpecName "kube-api-access-hzm5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:16:09.021521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.021502    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" (UID: "d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:16:09.028451 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.028428    2583 scope.go:117] "RemoveContainer" containerID="2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"
Sep 07 21:16:09.028765 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:16:09.028749    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc\": container with ID starting with 2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc not found: ID does not exist" containerID="2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"
Sep 07 21:16:09.028808 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.028773    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc"} err="failed to get container status \"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc\": rpc error: code = NotFound desc = could not find container \"2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc\": container with ID starting with 2e2ce048116991f31eaa79e51113bd386d0002c8b98dd909d52c9295a80c38fc not found: ID does not exist"
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119753    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbgnc\" (UniqueName: \"kubernetes.io/projected/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-kube-api-access-fbgnc\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119790    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c235c90-a9a0-4f8b-817c-b0c7a57a6563-plugins-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119800    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzm5c\" (UniqueName: \"kubernetes.io/projected/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-kube-api-access-hzm5c\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119810    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119819    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.119849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.119828    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:16:09.340383 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.340346    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:16:09.352046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.352012    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28fa6ddd-5797755d69-jw9sp"]
Sep 07 21:16:09.366763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.366731    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:16:09.383242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.383153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:09.383871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.383849    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8"]
Sep 07 21:16:09.484418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.484347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:09.585434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.585391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:09.917999 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:09.917960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:10.407237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:10.407210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:10.678393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:10.678302    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" path="/var/lib/kubelet/pods/9c235c90-a9a0-4f8b-817c-b0c7a57a6563/volumes"
Sep 07 21:16:10.678819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:10.678797    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" path="/var/lib/kubelet/pods/d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59/volumes"
Sep 07 21:16:12.115504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:12.115463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:12.479372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:12.479329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:12.577033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:12.576995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:12.838264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:12.838180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:12.890747 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:12.890712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:13.096162 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:13.096056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:13.294676 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:13.294623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:13.386345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:13.386261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:13.832304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:13.832261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:14.672995 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:14.672923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:14.774397 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:14.774358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:24.552108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:24.552014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:28.677084 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:28.677052    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:16:28.677606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:28.677584    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:16:40.051627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.051583    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:16:40.052329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052307    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" containerName="maas-api"
Sep 07 21:16:40.052414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052332    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" containerName="maas-api"
Sep 07 21:16:40.052414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052352    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" containerName="payload-pre-processing"
Sep 07 21:16:40.052414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052360    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" containerName="payload-pre-processing"
Sep 07 21:16:40.052558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052486    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5afa9fd-fdb1-4434-a6a5-1e62c4e2af59" containerName="maas-api"
Sep 07 21:16:40.052558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.052498    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c235c90-a9a0-4f8b-817c-b0c7a57a6563" containerName="payload-pre-processing"
Sep 07 21:16:40.057392 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.057366    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.060551 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.060472    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-9e1e8d\"/\"openshift-service-ca.crt\""
Sep 07 21:16:40.060551 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.060485    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-9e1e8d\"/\"default-dockercfg-td7n9\""
Sep 07 21:16:40.060551 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.060503    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-9e1e8d\"/\"autores-model-9e1e8d-kserve-self-signed-certs\""
Sep 07 21:16:40.060551 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.060508    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-9e1e8d\"/\"kube-root-ca.crt\""
Sep 07 21:16:40.067659 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.066911    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:16:40.082456 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.082404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:40.147769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.147769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.148021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147828    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.148021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.148021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7chr\" (UniqueName: \"kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.148021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.147993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249615 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249615 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7chr\" (UniqueName: \"kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.249872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.249831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.250205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.250106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.250205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.250140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.250289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.250221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.252064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.252041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.252295 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.252276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.258294 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.258271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7chr\" (UniqueName: \"kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr\") pod \"autores-model-9e1e8d-kserve-56847ffbf9-k59jb\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") " pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.371663 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.371569    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:40.645273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:40.645246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:16:40.647265 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:16:40.647232    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1343d4b0_1afd_4436_a800_2ad47d3d1297.slice/crio-4720fbb3d65c6a34b885b04d1f096a2370d7b31642b7f3d8efa0de908b6d0bf0 WatchSource:0}: Error finding container 4720fbb3d65c6a34b885b04d1f096a2370d7b31642b7f3d8efa0de908b6d0bf0: Status 404 returned error can't find the container with id 4720fbb3d65c6a34b885b04d1f096a2370d7b31642b7f3d8efa0de908b6d0bf0
Sep 07 21:16:41.189520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:41.189479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" event={"ID":"1343d4b0-1afd-4436-a800-2ad47d3d1297","Type":"ContainerStarted","Data":"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"}
Sep 07 21:16:41.189520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:41.189523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" event={"ID":"1343d4b0-1afd-4436-a800-2ad47d3d1297","Type":"ContainerStarted","Data":"4720fbb3d65c6a34b885b04d1f096a2370d7b31642b7f3d8efa0de908b6d0bf0"}
Sep 07 21:16:41.223848 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:41.223792    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" podStartSLOduration=1.223771908 podStartE2EDuration="1.223771908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:16:41.220699942 +0000 UTC m=+913.056826047" watchObservedRunningTime="2026-09-07 21:16:41.223771908 +0000 UTC m=+913.059898014"
Sep 07 21:16:43.985596 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:43.985531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:44.085592 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:44.085551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:44.164919 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:44.164872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:44.224266 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:44.224221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:44.319271 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:44.319169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:44.731561 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:44.731520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:45.013533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:45.013380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:45.159914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:45.159877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:47.567000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:47.566962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:47.661069 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:47.661026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:48.719818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:48.719771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:48.778674 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:48.778641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:49.033389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:49.033267    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:49.187140 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:49.187105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:49.284396 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:49.284268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:16:50.372651 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:50.372612    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:50.372651 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:50.372663    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:50.385322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:50.385296    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:16:51.256364 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:16:51.256335    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:17:02.485302 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:02.485267    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:02.585322 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:02.585273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:11.737134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:11.737073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:11.848127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:11.848091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:13.519288 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:13.519243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:13.798336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:13.798231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:16.069438 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:16.069405    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:17:16.086457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:16.086416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:16.458323 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:16.458284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:19.276643 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:19.276604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:20.716265 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:20.716229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:21.024588 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:21.024479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:21.255652 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:21.255615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:21.702934 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:21.702889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.243101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.243063    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:17:22.243630 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.243315    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" podUID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" containerName="maas-api" containerID="cri-o://64e6c8dfea86338bec9f1d32b4818bee98ba628b6b6cdef83116dcd0cd1ce877" gracePeriod=30
Sep 07 21:17:22.272830 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.272791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.319267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.319232    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:17:22.319531 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.319497    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" podUID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" containerName="payload-pre-processing" containerID="cri-o://7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52" gracePeriod=30
Sep 07 21:17:22.349990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.349711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.426584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.426539    2583 generic.go:356] "Generic (PLEG): container finished" podID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" containerID="64e6c8dfea86338bec9f1d32b4818bee98ba628b6b6cdef83116dcd0cd1ce877" exitCode=0
Sep 07 21:17:22.426669 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.426616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" event={"ID":"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471","Type":"ContainerDied","Data":"64e6c8dfea86338bec9f1d32b4818bee98ba628b6b6cdef83116dcd0cd1ce877"}
Sep 07 21:17:22.449268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.449228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.549501 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.549414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.605268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.605238    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:17:22.608290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.608266    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:17:22.608533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.608507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:22.695844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.695818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f6lx\" (UniqueName: \"kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx\") pod \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") "
Sep 07 21:17:22.696045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.695862    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls\") pod \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") "
Sep 07 21:17:22.696045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.695884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume\") pod \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\" (UID: \"2cd4c47b-7e24-4b8a-982b-6876b341e17d\") "
Sep 07 21:17:22.696045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.695930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj7hg\" (UniqueName: \"kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg\") pod \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") "
Sep 07 21:17:22.696045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.695959    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca\") pod \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") "
Sep 07 21:17:22.696208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.696051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs\") pod \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\" (UID: \"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471\") "
Sep 07 21:17:22.696395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.696369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" (UID: "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:22.696588 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.696559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cd4c47b-7e24-4b8a-982b-6876b341e17d" (UID: "2cd4c47b-7e24-4b8a-982b-6876b341e17d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:22.698711 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.698667    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" (UID: "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:22.698998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.698973    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx" (OuterVolumeSpecName: "kube-api-access-7f6lx") pod "2cd4c47b-7e24-4b8a-982b-6876b341e17d" (UID: "2cd4c47b-7e24-4b8a-982b-6876b341e17d"). InnerVolumeSpecName "kube-api-access-7f6lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:22.699108 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.699079    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg" (OuterVolumeSpecName: "kube-api-access-gj7hg") pod "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" (UID: "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471"). InnerVolumeSpecName "kube-api-access-gj7hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:22.699184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.699075    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" (UID: "4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797554    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797586    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f6lx\" (UniqueName: \"kubernetes.io/projected/2cd4c47b-7e24-4b8a-982b-6876b341e17d-kube-api-access-7f6lx\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797596    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797605    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cd4c47b-7e24-4b8a-982b-6876b341e17d-plugins-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797614    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj7hg\" (UniqueName: \"kubernetes.io/projected/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-kube-api-access-gj7hg\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.797640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.797625    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:22.899487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:22.899434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:23.434364 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.434328    2583 generic.go:356] "Generic (PLEG): container finished" podID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" containerID="7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52" exitCode=0
Sep 07 21:17:23.434814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.434377    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"
Sep 07 21:17:23.434814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.434412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" event={"ID":"2cd4c47b-7e24-4b8a-982b-6876b341e17d","Type":"ContainerDied","Data":"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"}
Sep 07 21:17:23.434814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.434462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l" event={"ID":"2cd4c47b-7e24-4b8a-982b-6876b341e17d","Type":"ContainerDied","Data":"58f10bcbd6638a9565c84f26aa65ae4bd30bd3abf8afb09e026429d0f7120787"}
Sep 07 21:17:23.434814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.434485    2583 scope.go:117] "RemoveContainer" containerID="7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"
Sep 07 21:17:23.436080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.436049    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c" event={"ID":"4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471","Type":"ContainerDied","Data":"cfb690a4dbdf6b71b0b8e52857a37a0feb0cc7012c0cbdc30cc3f9414b8fe1da"}
Sep 07 21:17:23.436224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.436058    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"
Sep 07 21:17:23.445971 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.445925    2583 scope.go:117] "RemoveContainer" containerID="7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"
Sep 07 21:17:23.446287 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:23.446258    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52\": container with ID starting with 7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52 not found: ID does not exist" containerID="7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"
Sep 07 21:17:23.446366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.446290    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52"} err="failed to get container status \"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52\": rpc error: code = NotFound desc = could not find container \"7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52\": container with ID starting with 7e1cbd5545aa66ac08cf2773a9208fddb164c787f2a5d48d70374b7f2cbdfd52 not found: ID does not exist"
Sep 07 21:17:23.446366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.446313    2583 scope.go:117] "RemoveContainer" containerID="64e6c8dfea86338bec9f1d32b4818bee98ba628b6b6cdef83116dcd0cd1ce877"
Sep 07 21:17:23.460578 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.460555    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:17:23.462641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.462621    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9e1e8d-7b8c7747-ntl7c"]
Sep 07 21:17:23.471725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.471699    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:17:23.477385 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.477361    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l"]
Sep 07 21:17:23.535200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.535157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:23.639634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:23.639595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:24.678201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:24.678168    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" path="/var/lib/kubelet/pods/2cd4c47b-7e24-4b8a-982b-6876b341e17d/volumes"
Sep 07 21:17:24.678595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:24.678586    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" path="/var/lib/kubelet/pods/4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471/volumes"
Sep 07 21:17:24.839516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:24.839485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:24.952077 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:24.951976    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:25.182303 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:25.182265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:25.412609 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:25.412569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:25.515171 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:25.515106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:27.975402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:27.975365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:28.626961 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:28.626902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:31.090831 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.090776    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerName="main" containerID="cri-o://9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1" gracePeriod=45
Sep 07 21:17:31.246038 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.245988    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": dial tcp 10.132.0.50:8000: connect: connection refused"
Sep 07 21:17:31.352700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.352630    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:17:31.481736 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.481702    2583 generic.go:356] "Generic (PLEG): container finished" podID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerID="9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1" exitCode=0
Sep 07 21:17:31.481910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.481761    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" event={"ID":"1343d4b0-1afd-4436-a800-2ad47d3d1297","Type":"ContainerDied","Data":"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"}
Sep 07 21:17:31.481910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.481766    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"
Sep 07 21:17:31.481910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.481790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb" event={"ID":"1343d4b0-1afd-4436-a800-2ad47d3d1297","Type":"ContainerDied","Data":"4720fbb3d65c6a34b885b04d1f096a2370d7b31642b7f3d8efa0de908b6d0bf0"}
Sep 07 21:17:31.481910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.481812    2583 scope.go:117] "RemoveContainer" containerID="9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"
Sep 07 21:17:31.484046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484151    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7chr\" (UniqueName: \"kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484193    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484296 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484259    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484296 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484281    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache" (OuterVolumeSpecName: "model-cache") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:31.484409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs\") pod \"1343d4b0-1afd-4436-a800-2ad47d3d1297\" (UID: \"1343d4b0-1afd-4436-a800-2ad47d3d1297\") "
Sep 07 21:17:31.484585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home" (OuterVolumeSpecName: "home") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:31.484585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484523    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:31.484762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.484739    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-model-cache\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.485301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.485193    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-tmp-dir\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.485301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.485214    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-home\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.486799 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.486769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:17:31.486891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.486820    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr" (OuterVolumeSpecName: "kube-api-access-m7chr") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "kube-api-access-m7chr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:31.486891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.486871    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm" (OuterVolumeSpecName: "dshm") pod "1343d4b0-1afd-4436-a800-2ad47d3d1297" (UID: "1343d4b0-1afd-4436-a800-2ad47d3d1297"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:31.493491 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.493433    2583 scope.go:117] "RemoveContainer" containerID="9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"
Sep 07 21:17:31.493849 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:31.493825    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1\": container with ID starting with 9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1 not found: ID does not exist" containerID="9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"
Sep 07 21:17:31.493897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.493861    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1"} err="failed to get container status \"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1\": rpc error: code = NotFound desc = could not find container \"9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1\": container with ID starting with 9d7e7d2a78fa762f4a0e40491c3a91e420248d59adfbae6ba960dc89ede95df1 not found: ID does not exist"
Sep 07 21:17:31.586169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.586110    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1343d4b0-1afd-4436-a800-2ad47d3d1297-tls-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.586169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.586157    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1343d4b0-1afd-4436-a800-2ad47d3d1297-dshm\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.586169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.586168    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7chr\" (UniqueName: \"kubernetes.io/projected/1343d4b0-1afd-4436-a800-2ad47d3d1297-kube-api-access-m7chr\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:31.803979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.803855    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:17:31.806274 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:31.806244    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-9e1e8d/autores-model-9e1e8d-kserve-56847ffbf9-k59jb"]
Sep 07 21:17:32.677389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:32.677344    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" path="/var/lib/kubelet/pods/1343d4b0-1afd-4436-a800-2ad47d3d1297/volumes"
Sep 07 21:17:33.810708 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:33.810672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:34.048460 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:34.048426    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:17:34.048679 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:34.048651    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy" containerID="cri-o://ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d" gracePeriod=30
Sep 07 21:17:34.068495 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:34.068402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:34.492179 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:34.492125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:34.840304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:34.840191    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:35.557603 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:35.557565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:37.537034 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:37.536999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:37.625260 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:37.625213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:38.663106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663068    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:17:38.663556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663536    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerName="main"
Sep 07 21:17:38.663556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663557    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerName="main"
Sep 07 21:17:38.663634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663568    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" containerName="maas-api"
Sep 07 21:17:38.663634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663574    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" containerName="maas-api"
Sep 07 21:17:38.663634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663600    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" containerName="payload-pre-processing"
Sep 07 21:17:38.663634 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663607    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" containerName="payload-pre-processing"
Sep 07 21:17:38.663781 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663701    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd4c47b-7e24-4b8a-982b-6876b341e17d" containerName="payload-pre-processing"
Sep 07 21:17:38.663781 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663711    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1343d4b0-1afd-4436-a800-2ad47d3d1297" containerName="main"
Sep 07 21:17:38.663781 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.663717    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ffc9f66-1c46-4c7e-b35b-b4e28d0c0471" containerName="maas-api"
Sep 07 21:17:38.668418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.668401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.670667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.670643    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f447ae-serving-cert\""
Sep 07 21:17:38.682133 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.682105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:17:38.714088 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.714052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:38.760214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.760173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.760398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.760269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.760398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.760302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.760398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.760329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.815554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.815512    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:38.861310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.861265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.861509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.861322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.861509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.861366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.861509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.861436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.861509 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:38.861487    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-serving-cert: secret "maas-api-e2e-explicit-f447ae-serving-cert" not found
Sep 07 21:17:38.861714 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:38.861549    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls podName:20bfaf59-bed9-4578-bdd5-6b9bd115797b nodeName:}" failed. No retries permitted until 2026-09-07 21:17:39.36153277 +0000 UTC m=+971.197658858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls") pod "maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" (UID: "20bfaf59-bed9-4578-bdd5-6b9bd115797b") : secret "maas-api-e2e-explicit-f447ae-serving-cert" not found
Sep 07 21:17:38.862144 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.862123    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.871475 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.864510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:38.874501 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:38.874479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:39.018523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.018423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:39.187240 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.187203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:39.288268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.288176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:39.332770 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.332742    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:17:39.367691 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.367653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:39.370158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.370128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") pod \"maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:39.468514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468594    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468616    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.468723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.469099 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468769    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.469099 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468809    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kms9d\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d\") pod \"b5b497ea-c4a4-4138-9579-627e836fa12f\" (UID: \"b5b497ea-c4a4-4138-9579-627e836fa12f\") "
Sep 07 21:17:39.469099 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.468911    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:39.469099 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469037    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:39.469301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:17:39.469301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469171    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:39.469301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469220    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5b497ea-c4a4-4138-9579-627e836fa12f-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.469301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469234    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.469301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469243    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.469552 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.469351    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:39.470902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.470869    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:17:39.470902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.470881    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:17:39.471086 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.470992    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d" (OuterVolumeSpecName: "kube-api-access-kms9d") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "kube-api-access-kms9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:39.471086 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.471010    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5b497ea-c4a4-4138-9579-627e836fa12f" (UID: "b5b497ea-c4a4-4138-9579-627e836fa12f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:17:39.528114 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.528078    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerID="ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d" exitCode=0
Sep 07 21:17:39.528278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.528129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerDied","Data":"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"}
Sep 07 21:17:39.528278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.528207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp" event={"ID":"b5b497ea-c4a4-4138-9579-627e836fa12f","Type":"ContainerDied","Data":"b344beea9dd2265d9baf7d1e89164bbad9d65f6c38c8e1954d54565936e2db5c"}
Sep 07 21:17:39.528278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.528223    2583 scope.go:117] "RemoveContainer" containerID="ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"
Sep 07 21:17:39.528278 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.528136    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"
Sep 07 21:17:39.538414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.538372    2583 scope.go:117] "RemoveContainer" containerID="5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"
Sep 07 21:17:39.546587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.546569    2583 scope.go:117] "RemoveContainer" containerID="ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"
Sep 07 21:17:39.546864 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:39.546844    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d\": container with ID starting with ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d not found: ID does not exist" containerID="ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"
Sep 07 21:17:39.546936 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.546872    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d"} err="failed to get container status \"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d\": rpc error: code = NotFound desc = could not find container \"ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d\": container with ID starting with ff388662c29f0d4bd93f2d0f7170392879c48692adcdcd8d08a9e48af823ed6d not found: ID does not exist"
Sep 07 21:17:39.546936 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.546891    2583 scope.go:117] "RemoveContainer" containerID="5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"
Sep 07 21:17:39.547175 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:17:39.547157    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2\": container with ID starting with 5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2 not found: ID does not exist" containerID="5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"
Sep 07 21:17:39.547215 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.547180    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2"} err="failed to get container status \"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2\": rpc error: code = NotFound desc = could not find container \"5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2\": container with ID starting with 5df4a7a63e9eb38883261a7bb8bb280468b626658d35dfb986f14af437ddfbb2 not found: ID does not exist"
Sep 07 21:17:39.550419 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.550396    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:17:39.556509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.556487    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp"]
Sep 07 21:17:39.570635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570612    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.570635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570633    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.570810 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570644    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.570810 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570651    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.570810 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570659    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5b497ea-c4a4-4138-9579-627e836fa12f-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.570810 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.570667    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kms9d\" (UniqueName: \"kubernetes.io/projected/b5b497ea-c4a4-4138-9579-627e836fa12f-kube-api-access-kms9d\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:17:39.582455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.582423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:39.857229 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:39.857203    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:17:39.858679 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:17:39.858650    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bfaf59_bed9_4578_bdd5_6b9bd115797b.slice/crio-f3a182e009724067b947c55dd4a0e696f01a7b9697d69343fe66318ce3c7530e WatchSource:0}: Error finding container f3a182e009724067b947c55dd4a0e696f01a7b9697d69343fe66318ce3c7530e: Status 404 returned error can't find the container with id f3a182e009724067b947c55dd4a0e696f01a7b9697d69343fe66318ce3c7530e
Sep 07 21:17:40.535894 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:40.535801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" event={"ID":"20bfaf59-bed9-4578-bdd5-6b9bd115797b","Type":"ContainerStarted","Data":"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"}
Sep 07 21:17:40.535894 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:40.535855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" event={"ID":"20bfaf59-bed9-4578-bdd5-6b9bd115797b","Type":"ContainerStarted","Data":"f3a182e009724067b947c55dd4a0e696f01a7b9697d69343fe66318ce3c7530e"}
Sep 07 21:17:40.536117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:40.535955    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:40.553597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:40.553530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" podStartSLOduration=2.210959398 podStartE2EDuration="2.553508368s" totalImagesPullingTime="342.54897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:17:40.551162444 +0000 UTC m=+972.387288550" watchObservedRunningTime="2026-09-07 21:17:40.553508368 +0000 UTC m=+972.389634475"
Sep 07 21:17:40.678408 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:40.678364    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" path="/var/lib/kubelet/pods/b5b497ea-c4a4-4138-9579-627e836fa12f/volumes"
Sep 07 21:17:45.937703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:45.937662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:46.545650 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:46.545618    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:17:53.635788 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:53.635749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:55.323469 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:55.323423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:55.426031 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:55.425990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:55.512541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:55.512501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:55.569436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:55.569401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:55.660492 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:55.660451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:56.315618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:56.315579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:56.414117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:56.414076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:56.514091 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:56.514042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:57.888253 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:57.888212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:17:59.584859 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:17:59.584825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:02.321192 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:02.321157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:02.881252 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:02.881209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:03.770214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:03.770178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:03.912861 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:03.912813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:04.042560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:04.042449    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:04.140019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:04.139969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:04.493283 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:04.493248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:29.952095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.952060    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:18:29.952645 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.952625    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:18:29.952694 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.952650    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:18:29.952800 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.952787    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:18:29.952836 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.952805    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:18:29.958134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.958107    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.962200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.962173    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-f447ae\"/\"kube-root-ca.crt\""
Sep 07 21:18:29.962640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.962197    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-f447ae\"/\"default-dockercfg-8mvcg\""
Sep 07 21:18:29.962758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.962499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-f447ae\"/\"explicit-model-f447ae-kserve-self-signed-certs\""
Sep 07 21:18:29.962823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.962578    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-f447ae\"/\"openshift-service-ca.crt\""
Sep 07 21:18:29.965533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.965507    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:18:29.969508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.969601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.969601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.969601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.969725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlzzh\" (UniqueName: \"kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.969761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.969730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:29.971470 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:29.971422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:30.070457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.070648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.070648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.070648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.071211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.071211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlzzh\" (UniqueName: \"kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.071211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070857    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.071211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070921    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.071211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.070978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.072872 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.072840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.073134 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.073117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.078581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.078559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlzzh\" (UniqueName: \"kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh\") pod \"explicit-model-f447ae-kserve-6888775f5f-98sj5\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") " pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.270419 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.270322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:30.387078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.387046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:30.543958 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.543918    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:18:30.546351 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:18:30.546320    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3616973_0d36_4aac_a14c_ae8f76fddd9a.slice/crio-e7aaf4c84a4ee3b52ad6a8e5d3bdb394fafbc57b0740ff0c996dbb669e2f2033 WatchSource:0}: Error finding container e7aaf4c84a4ee3b52ad6a8e5d3bdb394fafbc57b0740ff0c996dbb669e2f2033: Status 404 returned error can't find the container with id e7aaf4c84a4ee3b52ad6a8e5d3bdb394fafbc57b0740ff0c996dbb669e2f2033
Sep 07 21:18:30.817459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.817361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" event={"ID":"f3616973-0d36-4aac-a14c-ae8f76fddd9a","Type":"ContainerStarted","Data":"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"}
Sep 07 21:18:30.817459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.817405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" event={"ID":"f3616973-0d36-4aac-a14c-ae8f76fddd9a","Type":"ContainerStarted","Data":"e7aaf4c84a4ee3b52ad6a8e5d3bdb394fafbc57b0740ff0c996dbb669e2f2033"}
Sep 07 21:18:30.835215 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:30.835159    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" podStartSLOduration=1.835142887 podStartE2EDuration="1.835142887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:18:30.833395432 +0000 UTC m=+1022.669521538" watchObservedRunningTime="2026-09-07 21:18:30.835142887 +0000 UTC m=+1022.671268993"
Sep 07 21:18:36.137908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:36.137873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:36.205239 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:36.205189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:36.299318 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:36.299279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:40.270701 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.270660    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:40.270701 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.270707    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:40.283527 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.283500    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:40.884484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.884453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:40.964307 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.964272    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:18:40.971247 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:40.971213    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:40.971436 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:40.971298    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:18:41.471280958 +0000 UTC m=+1033.307407264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:40.979706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:40.979673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:41.475851 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:41.475795    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:41.476319 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:41.475894    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:18:42.475880024 +0000 UTC m=+1034.312006107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:42.482834 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:42.482799    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:42.483269 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:42.482874    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:18:44.482859297 +0000 UTC m=+1036.318985379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:44.504403 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:44.504361    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:44.504811 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:44.504442    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:18:48.504428 +0000 UTC m=+1040.340554083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:48.544926 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:48.544887    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:48.545368 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:48.544985    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:18:56.544969528 +0000 UTC m=+1048.381095612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:51.505568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.505518    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:18:51.506086 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.505784    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerName="maas-api" containerID="cri-o://132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e" gracePeriod=30
Sep 07 21:18:51.532582 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.532549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:51.541540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.541510    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.51:8443/health\": dial tcp 10.132.0.51:8443: connect: connection refused"
Sep 07 21:18:51.607683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.607580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:51.671115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.671059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:51.733204 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.733170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:51.762826 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.762759    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:18:51.876933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.876902    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca\") pod \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") "
Sep 07 21:18:51.877145 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.877127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs\") pod \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") "
Sep 07 21:18:51.877212 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.877163    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj\") pod \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") "
Sep 07 21:18:51.877319 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.877297    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") pod \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\" (UID: \"20bfaf59-bed9-4578-bdd5-6b9bd115797b\") "
Sep 07 21:18:51.877383 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.877344    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20bfaf59-bed9-4578-bdd5-6b9bd115797b" (UID: "20bfaf59-bed9-4578-bdd5-6b9bd115797b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:18:51.877717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.877695    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bfaf59-bed9-4578-bdd5-6b9bd115797b-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:51.879443 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.879416    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj" (OuterVolumeSpecName: "kube-api-access-4wvvj") pod "20bfaf59-bed9-4578-bdd5-6b9bd115797b" (UID: "20bfaf59-bed9-4578-bdd5-6b9bd115797b"). InnerVolumeSpecName "kube-api-access-4wvvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:18:51.879633 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.879612    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20bfaf59-bed9-4578-bdd5-6b9bd115797b" (UID: "20bfaf59-bed9-4578-bdd5-6b9bd115797b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:18:51.879719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.879697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20bfaf59-bed9-4578-bdd5-6b9bd115797b" (UID: "20bfaf59-bed9-4578-bdd5-6b9bd115797b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:18:51.933055 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.933020    2583 generic.go:356] "Generic (PLEG): container finished" podID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerID="132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e" exitCode=0
Sep 07 21:18:51.933231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.933072    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"
Sep 07 21:18:51.933231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.933098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" event={"ID":"20bfaf59-bed9-4578-bdd5-6b9bd115797b","Type":"ContainerDied","Data":"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"}
Sep 07 21:18:51.933231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.933154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr" event={"ID":"20bfaf59-bed9-4578-bdd5-6b9bd115797b","Type":"ContainerDied","Data":"f3a182e009724067b947c55dd4a0e696f01a7b9697d69343fe66318ce3c7530e"}
Sep 07 21:18:51.933231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.933179    2583 scope.go:117] "RemoveContainer" containerID="132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"
Sep 07 21:18:51.942731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.942712    2583 scope.go:117] "RemoveContainer" containerID="132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"
Sep 07 21:18:51.943025 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:51.943004    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e\": container with ID starting with 132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e not found: ID does not exist" containerID="132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"
Sep 07 21:18:51.943112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.943034    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e"} err="failed to get container status \"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e\": rpc error: code = NotFound desc = could not find container \"132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e\": container with ID starting with 132d1b06d345be6500428a86f13f8d07107b1b3a46af380cac87a6dfc888922e not found: ID does not exist"
Sep 07 21:18:51.956545 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.956519    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:18:51.959796 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.959766    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f447ae-5745bf8dd9-b49mr"]
Sep 07 21:18:51.979000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.978977    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:51.979000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.978999    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/20bfaf59-bed9-4578-bdd5-6b9bd115797b-kube-api-access-4wvvj\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:51.979119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:51.979009    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bfaf59-bed9-4578-bdd5-6b9bd115797b-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:52.070545 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:52.070448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:52.167719 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:52.167680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:52.677929 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:52.677880    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" path="/var/lib/kubelet/pods/20bfaf59-bed9-4578-bdd5-6b9bd115797b/volumes"
Sep 07 21:18:56.624567 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:56.624528    2583 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-self-signed-certs: secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:56.625017 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:56.624619    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs podName:f3616973-0d36-4aac-a14c-ae8f76fddd9a nodeName:}" failed. No retries permitted until 2026-09-07 21:19:12.624603702 +0000 UTC m=+1064.460729784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs") pod "explicit-model-f447ae-kserve-6888775f5f-98sj5" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a") : secret "explicit-model-f447ae-kserve-self-signed-certs" not found
Sep 07 21:18:57.143071 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:57.143031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:57.869060 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:57.869011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:57.906059 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:57.906020    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" podUID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" containerName="main" containerID="cri-o://db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0" gracePeriod=45
Sep 07 21:18:57.971779 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:57.971750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:58.070402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.070364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:18:58.162641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.162616    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:58.240224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240192    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240271    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240312    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240341    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlzzh\" (UniqueName: \"kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240400    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache\") pod \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\" (UID: \"f3616973-0d36-4aac-a14c-ae8f76fddd9a\") "
Sep 07 21:18:58.240738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240485    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:58.240738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240559    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home" (OuterVolumeSpecName: "home") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:58.240738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240697    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tmp-dir\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.240738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240719    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-home\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.240917 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.240740    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:58.242619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.242588    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh" (OuterVolumeSpecName: "kube-api-access-vlzzh") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "kube-api-access-vlzzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:18:58.242619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.242612    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:18:58.242760 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.242640    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm" (OuterVolumeSpecName: "dshm") pod "f3616973-0d36-4aac-a14c-ae8f76fddd9a" (UID: "f3616973-0d36-4aac-a14c-ae8f76fddd9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:18:58.341969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.341911    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3616973-0d36-4aac-a14c-ae8f76fddd9a-tls-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.341969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.341967    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlzzh\" (UniqueName: \"kubernetes.io/projected/f3616973-0d36-4aac-a14c-ae8f76fddd9a-kube-api-access-vlzzh\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.341969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.341978    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-dshm\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.342207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.341987    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3616973-0d36-4aac-a14c-ae8f76fddd9a-model-cache\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:18:58.974560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.974471    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" containerID="db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0" exitCode=0
Sep 07 21:18:58.974560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.974517    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"
Sep 07 21:18:58.975075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.974558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" event={"ID":"f3616973-0d36-4aac-a14c-ae8f76fddd9a","Type":"ContainerDied","Data":"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"}
Sep 07 21:18:58.975075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.974605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5" event={"ID":"f3616973-0d36-4aac-a14c-ae8f76fddd9a","Type":"ContainerDied","Data":"e7aaf4c84a4ee3b52ad6a8e5d3bdb394fafbc57b0740ff0c996dbb669e2f2033"}
Sep 07 21:18:58.975075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.974623    2583 scope.go:117] "RemoveContainer" containerID="db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"
Sep 07 21:18:58.983268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.983247    2583 scope.go:117] "RemoveContainer" containerID="db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"
Sep 07 21:18:58.983549 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:18:58.983531    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0\": container with ID starting with db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0 not found: ID does not exist" containerID="db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"
Sep 07 21:18:58.983601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.983559    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0"} err="failed to get container status \"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0\": rpc error: code = NotFound desc = could not find container \"db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0\": container with ID starting with db0b04371574bee53d945fc960fecef52c55b73251cd1313842a9563686f0ec0 not found: ID does not exist"
Sep 07 21:18:58.990505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.990484    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:18:58.992348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:18:58.992328    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-f447ae/explicit-model-f447ae-kserve-6888775f5f-98sj5"]
Sep 07 21:19:00.677915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:00.677878    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" path="/var/lib/kubelet/pods/f3616973-0d36-4aac-a14c-ae8f76fddd9a/volumes"
Sep 07 21:19:03.032406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.032371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:03.238618 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.238581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:03.673281 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.673243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:03.957021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.956933    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:03.957373 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957361    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" containerName="main"
Sep 07 21:19:03.957416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957379    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" containerName="main"
Sep 07 21:19:03.957416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957402    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerName="maas-api"
Sep 07 21:19:03.957416 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957408    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerName="maas-api"
Sep 07 21:19:03.957509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957417    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:19:03.957509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957422    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b497ea-c4a4-4138-9579-627e836fa12f" containerName="istio-proxy"
Sep 07 21:19:03.957509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957489    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3616973-0d36-4aac-a14c-ae8f76fddd9a" containerName="main"
Sep 07 21:19:03.957509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.957501    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="20bfaf59-bed9-4578-bdd5-6b9bd115797b" containerName="maas-api"
Sep 07 21:19:03.962535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.962515    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:03.964884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.964861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 21:19:03.964988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.964894    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-6223ec-openshift-default-dockercfg-pmf48\""
Sep 07 21:19:03.973553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.973529    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:03.978816 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:03.978773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:04.095899 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.095862    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.095899 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.095907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.095928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.095961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.096026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4kf\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.096077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.096122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.096139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.096357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.096172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4kf\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.197776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.197717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.198907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.198126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.198907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.198391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.198907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.198554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.198907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.198613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.200042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.200020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.200208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.200191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.205366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.205346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.205689 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.205654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4kf\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf\") pod \"e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") " pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.274665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.274566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:04.324490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.324450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:04.554466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.554412    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:04.556934 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:19:04.556894    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20987bf3_e386_48c3_95ad_65b21b6e3fee.slice/crio-6fd9b303c71300f625cd901d489c6801849efee951cefa1a9e0d3b6d66b8f597 WatchSource:0}: Error finding container 6fd9b303c71300f625cd901d489c6801849efee951cefa1a9e0d3b6d66b8f597: Status 404 returned error can't find the container with id 6fd9b303c71300f625cd901d489c6801849efee951cefa1a9e0d3b6d66b8f597
Sep 07 21:19:04.559218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.559183    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:04.559277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.559253    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:04.559317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:04.559283    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:05.010193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.010149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" event={"ID":"20987bf3-e386-48c3-95ad-65b21b6e3fee","Type":"ContainerStarted","Data":"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"}
Sep 07 21:19:05.010371 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.010212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" event={"ID":"20987bf3-e386-48c3-95ad-65b21b6e3fee","Type":"ContainerStarted","Data":"6fd9b303c71300f625cd901d489c6801849efee951cefa1a9e0d3b6d66b8f597"}
Sep 07 21:19:05.028843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.028787    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" podStartSLOduration=2.028767501 podStartE2EDuration="2.028767501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:19:05.027495245 +0000 UTC m=+1056.863621351" watchObservedRunningTime="2026-09-07 21:19:05.028767501 +0000 UTC m=+1056.864893606"
Sep 07 21:19:05.275058 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.274977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:05.280113 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.280085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:05.305669 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.305629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:05.396515 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.396480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:05.497011 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:05.496975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:06.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:06.015352    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:06.016510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:06.016491    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:08.505619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:08.505582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:09.284118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:09.284078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:13.362184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:13.362140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:14.975121 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:14.975086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:15.078051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:15.078004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:15.176960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:15.176910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:15.229181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:15.229094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:15.897617 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:15.897573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:15.987099 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:15.987064    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:16.090025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:16.089972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:17.513312 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:17.513271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:23.265638 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:23.265542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:23.326343 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:23.326304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:23.922769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:23.922730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:29.524406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:29.524365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:29.628459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:29.628422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:29.753237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:29.753198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:30.026512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.026477    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:19:30.032174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.032145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.034778 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.034756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f838f49c-openshift-default-dockercfg-v7hq2\""
Sep 07 21:19:30.044510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.044484    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:19:30.058172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.058138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:30.138178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138137    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138363 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x87t2\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138654 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.138654 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.138596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x87t2\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240492 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240492 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240840 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.240901 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.240837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.241098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.241078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.243068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.243042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.243261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.243242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.247749 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.247729    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.248093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.248073    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x87t2\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2\") pod \"e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") " pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.343965 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.343873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:30.421122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.421090    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:30.621217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.621190    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:19:30.623133 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:19:30.623108    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf692ea01_01ce_4ac1_9a34_c047b6a7552f.slice/crio-38172402ff0caa3dc953fa0b6b526e86bcb8aff642500591de55576a350f0d8f WatchSource:0}: Error finding container 38172402ff0caa3dc953fa0b6b526e86bcb8aff642500591de55576a350f0d8f: Status 404 returned error can't find the container with id 38172402ff0caa3dc953fa0b6b526e86bcb8aff642500591de55576a350f0d8f
Sep 07 21:19:30.625528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.625497    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:30.625600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.625588    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:30.625635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:30.625617    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:31.149243 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:31.149203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerStarted","Data":"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"}
Sep 07 21:19:31.149441 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:31.149268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerStarted","Data":"38172402ff0caa3dc953fa0b6b526e86bcb8aff642500591de55576a350f0d8f"}
Sep 07 21:19:31.169067 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:31.169001    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podStartSLOduration=1.168984241 podStartE2EDuration="1.168984241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:19:31.166908052 +0000 UTC m=+1083.003034156" watchObservedRunningTime="2026-09-07 21:19:31.168984241 +0000 UTC m=+1083.005110346"
Sep 07 21:19:31.344412 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:31.344377    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:31.349777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:31.349751    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:32.154408 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:32.154376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:32.155559 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:32.155541    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:33.139244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:33.139203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:33.231528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:33.231492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:34.532512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:34.532480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:34.628273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:34.628242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:34.723595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:34.723555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:35.006483 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:35.006426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:35.110447 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:35.110414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:46.938855 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:46.938805    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:46.939515 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:46.939475    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerName="istio-proxy" containerID="cri-o://6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef" gracePeriod=30
Sep 07 21:19:46.958000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:46.957969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:47.179494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:47.179453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:47.286918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:47.286806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:49.686584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:49.686541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:50.859858 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:50.859820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:51.018493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:51.018456    2583 patch_prober.go:28] interesting pod/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:19:51.018707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:51.018518    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:19:51.656800 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:51.656762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:51.988289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:51.988233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:52.217344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.217269    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:52.267166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.267125    2583 generic.go:356] "Generic (PLEG): container finished" podID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerID="6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef" exitCode=0
Sep 07 21:19:52.267166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.267179    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"
Sep 07 21:19:52.267513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.267210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" event={"ID":"20987bf3-e386-48c3-95ad-65b21b6e3fee","Type":"ContainerDied","Data":"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"}
Sep 07 21:19:52.267513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.267290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx" event={"ID":"20987bf3-e386-48c3-95ad-65b21b6e3fee","Type":"ContainerDied","Data":"6fd9b303c71300f625cd901d489c6801849efee951cefa1a9e0d3b6d66b8f597"}
Sep 07 21:19:52.267513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.267325    2583 scope.go:117] "RemoveContainer" containerID="6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"
Sep 07 21:19:52.277016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.276992    2583 scope.go:117] "RemoveContainer" containerID="6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"
Sep 07 21:19:52.277343 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:19:52.277322    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef\": container with ID starting with 6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef not found: ID does not exist" containerID="6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"
Sep 07 21:19:52.277423 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.277350    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef"} err="failed to get container status \"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef\": rpc error: code = NotFound desc = could not find container \"6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef\": container with ID starting with 6fb970a928c16a5078f785443c529619feb60a149c73d064afdf0dbdb26970ef not found: ID does not exist"
Sep 07 21:19:52.278329 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278363    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278395    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q4kf\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.278675 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278601    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:19:52.278722 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:19:52.278998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.278980    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.279123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279009    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:19:52.279123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279015    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.279123 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket\") pod \"20987bf3-e386-48c3-95ad-65b21b6e3fee\" (UID: \"20987bf3-e386-48c3-95ad-65b21b6e3fee\") "
Sep 07 21:19:52.279292 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data" (OuterVolumeSpecName: "istio-data") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:19:52.279526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279497    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:19:52.279616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279554    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.279616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279574    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.279616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279590    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.279616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.279604    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20987bf3-e386-48c3-95ad-65b21b6e3fee-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.280764 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.280736    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf" (OuterVolumeSpecName: "kube-api-access-9q4kf") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "kube-api-access-9q4kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:19:52.281103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.281068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:19:52.281103 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.281089    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:19:52.281279 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.281254    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token" (OuterVolumeSpecName: "istio-token") pod "20987bf3-e386-48c3-95ad-65b21b6e3fee" (UID: "20987bf3-e386-48c3-95ad-65b21b6e3fee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:19:52.352803 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.352765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:52.380236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.380202    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.380236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.380232    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.380236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.380241    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.380479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.380249    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20987bf3-e386-48c3-95ad-65b21b6e3fee-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.380479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.380258    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q4kf\" (UniqueName: \"kubernetes.io/projected/20987bf3-e386-48c3-95ad-65b21b6e3fee-kube-api-access-9q4kf\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:19:52.589641 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.589604    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:52.594859 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.594827    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx"]
Sep 07 21:19:52.679182 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:52.679135    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" path="/var/lib/kubelet/pods/20987bf3-e386-48c3-95ad-65b21b6e3fee/volumes"
Sep 07 21:19:54.281065 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.281026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerDied","Data":"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"}
Sep 07 21:19:54.281574 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.281211    2583 generic.go:356] "Generic (PLEG): container finished" podID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerID="7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513" exitCode=0
Sep 07 21:19:54.281574 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.281456    2583 scope.go:117] "RemoveContainer" containerID="7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"
Sep 07 21:19:54.282555 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.282523    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:54.282648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.282595    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:54.282648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:54.282625    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:19:55.289376 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:55.289339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerStarted","Data":"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"}
Sep 07 21:19:55.345039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:55.344995    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:19:55.345222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:55.345072    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:19:55.345222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:55.345116    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:19:56.318236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:56.318199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:56.344433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:56.344401    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:19:56.344600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:56.344459    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:19:57.344337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:57.344290    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:19:57.344822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:57.344351    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:19:57.975994 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:57.975929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:58.344586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:58.344495    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:19:58.344586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:58.344551    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:19:58.635011 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:58.634891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:58.729116 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:58.729079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:59.010160 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:59.010122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:19:59.344883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:59.344786    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:19:59.344883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:19:59.344847    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:20:00.344806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:00.344769    2583 patch_prober.go:28] interesting pod/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 07 21:20:00.345034 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:00.344829    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 07 21:20:01.348891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:01.348854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:20:01.349353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:01.349186    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:20:01.350054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:01.350034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:20:02.027710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.027670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:02.655379 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.655330    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:20:02.655876 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.655594    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" podUID="42192f85-95fe-4851-9221-ade5e8f428e4" containerName="maas-api" containerID="cri-o://c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd" gracePeriod=30
Sep 07 21:20:02.679152 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.679120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:02.712022 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.711689    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:20:02.712022 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.712015    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" podUID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" containerName="payload-pre-processing" containerID="cri-o://ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd" gracePeriod=30
Sep 07 21:20:02.779786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.779755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:02.864561 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.864528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:02.928218 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.928136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:02.973268 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:02.973240    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:20:03.013579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.013546    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:20:03.090606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q792p\" (UniqueName: \"kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p\") pod \"42192f85-95fe-4851-9221-ade5e8f428e4\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") "
Sep 07 21:20:03.090892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") pod \"42192f85-95fe-4851-9221-ade5e8f428e4\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") "
Sep 07 21:20:03.090892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090688    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5wm\" (UniqueName: \"kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm\") pod \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") "
Sep 07 21:20:03.090892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090729    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs\") pod \"42192f85-95fe-4851-9221-ade5e8f428e4\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") "
Sep 07 21:20:03.090892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090770    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume\") pod \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\" (UID: \"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c\") "
Sep 07 21:20:03.090892 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.090840    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca\") pod \"42192f85-95fe-4851-9221-ade5e8f428e4\" (UID: \"42192f85-95fe-4851-9221-ade5e8f428e4\") "
Sep 07 21:20:03.091313 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.091285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42192f85-95fe-4851-9221-ade5e8f428e4" (UID: "42192f85-95fe-4851-9221-ade5e8f428e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:03.091397 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.091303    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" (UID: "6d46c27d-9dff-4e7f-a17d-af936fd4ef8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:03.092916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.092883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "42192f85-95fe-4851-9221-ade5e8f428e4" (UID: "42192f85-95fe-4851-9221-ade5e8f428e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:03.093036 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.092925    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p" (OuterVolumeSpecName: "kube-api-access-q792p") pod "42192f85-95fe-4851-9221-ade5e8f428e4" (UID: "42192f85-95fe-4851-9221-ade5e8f428e4"). InnerVolumeSpecName "kube-api-access-q792p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:03.093371 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.093353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42192f85-95fe-4851-9221-ade5e8f428e4" (UID: "42192f85-95fe-4851-9221-ade5e8f428e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:20:03.093441 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.093407    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm" (OuterVolumeSpecName: "kube-api-access-vq5wm") pod "6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" (UID: "6d46c27d-9dff-4e7f-a17d-af936fd4ef8c"). InnerVolumeSpecName "kube-api-access-vq5wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191820    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q792p\" (UniqueName: \"kubernetes.io/projected/42192f85-95fe-4851-9221-ade5e8f428e4-kube-api-access-q792p\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191858    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191867    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5wm\" (UniqueName: \"kubernetes.io/projected/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-kube-api-access-vq5wm\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191878    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42192f85-95fe-4851-9221-ade5e8f428e4-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191887    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c-plugins-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.191915 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.191895    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42192f85-95fe-4851-9221-ade5e8f428e4-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:03.209616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.209562    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:03.344595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.344561    2583 generic.go:356] "Generic (PLEG): container finished" podID="42192f85-95fe-4851-9221-ade5e8f428e4" containerID="c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd" exitCode=0
Sep 07 21:20:03.344595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.344599    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"
Sep 07 21:20:03.344873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.344643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" event={"ID":"42192f85-95fe-4851-9221-ade5e8f428e4","Type":"ContainerDied","Data":"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"}
Sep 07 21:20:03.344873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.344699    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t" event={"ID":"42192f85-95fe-4851-9221-ade5e8f428e4","Type":"ContainerDied","Data":"d00df6dbbed793d83e1d1b397aaa326fea60e4f9f869e52bf364611e73461c9b"}
Sep 07 21:20:03.344873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.344725    2583 scope.go:117] "RemoveContainer" containerID="c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"
Sep 07 21:20:03.346174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.346142    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" containerID="ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd" exitCode=0
Sep 07 21:20:03.346275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.346188    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"
Sep 07 21:20:03.346275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.346230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" event={"ID":"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c","Type":"ContainerDied","Data":"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"}
Sep 07 21:20:03.346275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.346266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l" event={"ID":"6d46c27d-9dff-4e7f-a17d-af936fd4ef8c","Type":"ContainerDied","Data":"9ce2661244e8fc58123f805e82ece71ed42bdcb56db4e57413fea8eeb09fabe7"}
Sep 07 21:20:03.354348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.354331    2583 scope.go:117] "RemoveContainer" containerID="c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"
Sep 07 21:20:03.354629 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:20:03.354608    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd\": container with ID starting with c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd not found: ID does not exist" containerID="c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"
Sep 07 21:20:03.354703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.354640    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd"} err="failed to get container status \"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd\": rpc error: code = NotFound desc = could not find container \"c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd\": container with ID starting with c190cbafb2637619bf18bd1c3eb850d0af9d8e6a17c48ea070f61c3336d40fdd not found: ID does not exist"
Sep 07 21:20:03.354703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.354662    2583 scope.go:117] "RemoveContainer" containerID="ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"
Sep 07 21:20:03.363019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.363000    2583 scope.go:117] "RemoveContainer" containerID="ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"
Sep 07 21:20:03.363309 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:20:03.363289    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd\": container with ID starting with ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd not found: ID does not exist" containerID="ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"
Sep 07 21:20:03.363358 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.363316    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd"} err="failed to get container status \"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd\": rpc error: code = NotFound desc = could not find container \"ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd\": container with ID starting with ef8c680899f95e4ed9d526fe55d856e9e43cb4dd483f7aedc24c7ce5a6242ecd not found: ID does not exist"
Sep 07 21:20:03.368992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.368966    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:20:03.374675 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.374650    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l"]
Sep 07 21:20:03.384427 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.384400    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:20:03.397466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:03.397437    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-06f0f6-7c5bd77697-d5m2t"]
Sep 07 21:20:04.677809 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:04.677768    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42192f85-95fe-4851-9221-ade5e8f428e4" path="/var/lib/kubelet/pods/42192f85-95fe-4851-9221-ade5e8f428e4/volumes"
Sep 07 21:20:04.678224 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:04.678166    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" path="/var/lib/kubelet/pods/6d46c27d-9dff-4e7f-a17d-af936fd4ef8c/volumes"
Sep 07 21:20:04.874657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:04.874623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:04.935269 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:04.935174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:05.220434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220349    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"]
Sep 07 21:20:05.220776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220764    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerName="istio-proxy"
Sep 07 21:20:05.220820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220778    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerName="istio-proxy"
Sep 07 21:20:05.220820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220788    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" containerName="payload-pre-processing"
Sep 07 21:20:05.220820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220794    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" containerName="payload-pre-processing"
Sep 07 21:20:05.220820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220800    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42192f85-95fe-4851-9221-ade5e8f428e4" containerName="maas-api"
Sep 07 21:20:05.220820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220806    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="42192f85-95fe-4851-9221-ade5e8f428e4" containerName="maas-api"
Sep 07 21:20:05.220997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220898    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="20987bf3-e386-48c3-95ad-65b21b6e3fee" containerName="istio-proxy"
Sep 07 21:20:05.220997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220906    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d46c27d-9dff-4e7f-a17d-af936fd4ef8c" containerName="payload-pre-processing"
Sep 07 21:20:05.220997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.220912    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="42192f85-95fe-4851-9221-ade5e8f428e4" containerName="maas-api"
Sep 07 21:20:05.225733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.225712    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:05.228321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.228285    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:20:05.228481 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.228287    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:20:05.230365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.230338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"]
Sep 07 21:20:05.312331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.312298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:05.317513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.317479    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw\" (UID: \"22edaf13-9aa5-43ba-ab8d-f6b832c3a793\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:05.418458 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.418411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw\" (UID: \"22edaf13-9aa5-43ba-ab8d-f6b832c3a793\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:05.419080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.419058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw\" (UID: \"22edaf13-9aa5-43ba-ab8d-f6b832c3a793\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:05.538643 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.538554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:05.817302 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:05.817233    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"]
Sep 07 21:20:05.820023 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:05.819990    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22edaf13_9aa5_43ba_ab8d_f6b832c3a793.slice/crio-d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b WatchSource:0}: Error finding container d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b: Status 404 returned error can't find the container with id d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b
Sep 07 21:20:06.367232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:06.367141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw" event={"ID":"22edaf13-9aa5-43ba-ab8d-f6b832c3a793","Type":"ContainerStarted","Data":"ca39423bf41760d4681b853492e6926c8615c610a655b081261a89536e90a920"}
Sep 07 21:20:06.367232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:06.367192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw" event={"ID":"22edaf13-9aa5-43ba-ab8d-f6b832c3a793","Type":"ContainerStarted","Data":"d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b"}
Sep 07 21:20:06.383538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:06.383481    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw" podStartSLOduration=1.383464635 podStartE2EDuration="1.383464635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:06.380572621 +0000 UTC m=+1118.216698737" watchObservedRunningTime="2026-09-07 21:20:06.383464635 +0000 UTC m=+1118.219590797"
Sep 07 21:20:07.373796 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:07.373761    2583 generic.go:356] "Generic (PLEG): container finished" podID="22edaf13-9aa5-43ba-ab8d-f6b832c3a793" containerID="ca39423bf41760d4681b853492e6926c8615c610a655b081261a89536e90a920" exitCode=0
Sep 07 21:20:07.374232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:07.373844    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw" event={"ID":"22edaf13-9aa5-43ba-ab8d-f6b832c3a793","Type":"ContainerDied","Data":"ca39423bf41760d4681b853492e6926c8615c610a655b081261a89536e90a920"}
Sep 07 21:20:08.524030 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.524004    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:08.653115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.653020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca\") pod \"22edaf13-9aa5-43ba-ab8d-f6b832c3a793\" (UID: \"22edaf13-9aa5-43ba-ab8d-f6b832c3a793\") "
Sep 07 21:20:08.653402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.653376    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22edaf13-9aa5-43ba-ab8d-f6b832c3a793" (UID: "22edaf13-9aa5-43ba-ab8d-f6b832c3a793"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:08.754591 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.754549    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22edaf13-9aa5-43ba-ab8d-f6b832c3a793-maas-api-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:08.906653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.906618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:08.963454 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:08.963411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:09.155473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.155440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:09.386716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.386635    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"
Sep 07 21:20:09.386716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.386681    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw" event={"ID":"22edaf13-9aa5-43ba-ab8d-f6b832c3a793","Type":"ContainerDied","Data":"d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b"}
Sep 07 21:20:09.386897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.386731    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d32b1ff658f3d889d7fa70512a07976128f607b1c6621baaeae0af0584dbab5b"
Sep 07 21:20:09.461889 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.461852    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"]
Sep 07 21:20:09.462301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.462288    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22edaf13-9aa5-43ba-ab8d-f6b832c3a793" containerName="revoke-keys"
Sep 07 21:20:09.462357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.462303    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22edaf13-9aa5-43ba-ab8d-f6b832c3a793" containerName="revoke-keys"
Sep 07 21:20:09.462403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.462389    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22edaf13-9aa5-43ba-ab8d-f6b832c3a793" containerName="revoke-keys"
Sep 07 21:20:09.465640 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.465622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:09.467818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.467787    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:20:09.467818 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.467812    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:20:09.472565 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.472540    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"]
Sep 07 21:20:09.563625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.563581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp\" (UID: \"88eb23c8-a266-4777-8585-161e283d11ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:09.616482 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.616442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:09.664776 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.664745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp\" (UID: \"88eb23c8-a266-4777-8585-161e283d11ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:09.665388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.665367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp\" (UID: \"88eb23c8-a266-4777-8585-161e283d11ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:09.778476 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:09.778432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:10.050280 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:10.050252    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"]
Sep 07 21:20:10.052222 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:10.052191    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eb23c8_a266_4777_8585_161e283d11ec.slice/crio-d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807 WatchSource:0}: Error finding container d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807: Status 404 returned error can't find the container with id d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807
Sep 07 21:20:10.394078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:10.393975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp" event={"ID":"88eb23c8-a266-4777-8585-161e283d11ec","Type":"ContainerStarted","Data":"0c8d762db252c766eb3dcad7f537684d6d944e7a936ce43c1c3d76edbb1b03ee"}
Sep 07 21:20:10.394078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:10.394043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp" event={"ID":"88eb23c8-a266-4777-8585-161e283d11ec","Type":"ContainerStarted","Data":"d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807"}
Sep 07 21:20:10.407349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:10.407298    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp" podStartSLOduration=1.407281026 podStartE2EDuration="1.407281026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:10.406526393 +0000 UTC m=+1122.242652500" watchObservedRunningTime="2026-09-07 21:20:10.407281026 +0000 UTC m=+1122.243407161"
Sep 07 21:20:11.402790 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:11.402747    2583 generic.go:356] "Generic (PLEG): container finished" podID="88eb23c8-a266-4777-8585-161e283d11ec" containerID="0c8d762db252c766eb3dcad7f537684d6d944e7a936ce43c1c3d76edbb1b03ee" exitCode=0
Sep 07 21:20:11.403313 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:11.402842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp" event={"ID":"88eb23c8-a266-4777-8585-161e283d11ec","Type":"ContainerDied","Data":"0c8d762db252c766eb3dcad7f537684d6d944e7a936ce43c1c3d76edbb1b03ee"}
Sep 07 21:20:12.556359 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:12.556334    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:12.691563 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:12.691467    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca\") pod \"88eb23c8-a266-4777-8585-161e283d11ec\" (UID: \"88eb23c8-a266-4777-8585-161e283d11ec\") "
Sep 07 21:20:12.691839 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:12.691812    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88eb23c8-a266-4777-8585-161e283d11ec" (UID: "88eb23c8-a266-4777-8585-161e283d11ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:12.793188 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:12.793137    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb23c8-a266-4777-8585-161e283d11ec-maas-api-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:13.414494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:13.414465    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"
Sep 07 21:20:13.414715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:13.414458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp" event={"ID":"88eb23c8-a266-4777-8585-161e283d11ec","Type":"ContainerDied","Data":"d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807"}
Sep 07 21:20:13.414715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:13.414595    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d559c07530e0af6a8d8382a7aecf9937ac59a8cf8a00f0edd2de779e711b8807"
Sep 07 21:20:15.339063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:15.339027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:15.879405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:15.879374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:15.979337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:15.979302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:16.067745 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.067708    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"]
Sep 07 21:20:16.070346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.070307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:16.070713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.070694    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f838f49c-wwqsw"]
Sep 07 21:20:16.191173 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.191128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:16.428428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.428382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:16.678326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:16.678296    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22edaf13-9aa5-43ba-ab8d-f6b832c3a793" path="/var/lib/kubelet/pods/22edaf13-9aa5-43ba-ab8d-f6b832c3a793/volumes"
Sep 07 21:20:19.605370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:19.605327    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.189627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.189596    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.218783 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.218748    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:20:20.219049 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.219017    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" podUID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" containerName="payload-processing" containerID="cri-o://183ae8b37c635e4662afe27166aa5b33a42ad331fe19ff4810773c494d31feb5" gracePeriod=30
Sep 07 21:20:20.226337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.226304    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:20:20.226870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.226819    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" podUID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" containerName="payload-pre-processing" containerID="cri-o://de4c84fa681348e2dcb5b09e08ff5aa58420cad24697f047c377401cd35fc88e" gracePeriod=30
Sep 07 21:20:20.264546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.264509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.328561 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.328527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.387431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.387349    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"]
Sep 07 21:20:20.389648 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.389612    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.389914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.389893    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3102b2-55fqp"]
Sep 07 21:20:20.454647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.454495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.457275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.457240    2583 generic.go:356] "Generic (PLEG): container finished" podID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" containerID="de4c84fa681348e2dcb5b09e08ff5aa58420cad24697f047c377401cd35fc88e" exitCode=0
Sep 07 21:20:20.457441 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.457319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" event={"ID":"ca0a042a-9f0d-46b9-a5d9-826bc353974d","Type":"ContainerDied","Data":"de4c84fa681348e2dcb5b09e08ff5aa58420cad24697f047c377401cd35fc88e"}
Sep 07 21:20:20.459337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.459311    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" containerID="183ae8b37c635e4662afe27166aa5b33a42ad331fe19ff4810773c494d31feb5" exitCode=0
Sep 07 21:20:20.459446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.459392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" event={"ID":"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d","Type":"ContainerDied","Data":"183ae8b37c635e4662afe27166aa5b33a42ad331fe19ff4810773c494d31feb5"}
Sep 07 21:20:20.513982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.513935    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:20:20.517202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.517172    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:20:20.676441 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.676402    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8kp7\" (UniqueName: \"kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7\") pod \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") "
Sep 07 21:20:20.676957 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.676456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume\") pod \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\" (UID: \"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d\") "
Sep 07 21:20:20.676957 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.676558    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hdkb\" (UniqueName: \"kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb\") pod \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") "
Sep 07 21:20:20.676957 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.676583    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume\") pod \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\" (UID: \"ca0a042a-9f0d-46b9-a5d9-826bc353974d\") "
Sep 07 21:20:20.676957 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.676898    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" (UID: "d1f6bbfe-192a-4c98-9b83-48cf6d8b185d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:20.677389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.677362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca0a042a-9f0d-46b9-a5d9-826bc353974d" (UID: "ca0a042a-9f0d-46b9-a5d9-826bc353974d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:20.677809 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.677788    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88eb23c8-a266-4777-8585-161e283d11ec" path="/var/lib/kubelet/pods/88eb23c8-a266-4777-8585-161e283d11ec/volumes"
Sep 07 21:20:20.678870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.678839    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb" (OuterVolumeSpecName: "kube-api-access-7hdkb") pod "ca0a042a-9f0d-46b9-a5d9-826bc353974d" (UID: "ca0a042a-9f0d-46b9-a5d9-826bc353974d"). InnerVolumeSpecName "kube-api-access-7hdkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:20.679095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.679071    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7" (OuterVolumeSpecName: "kube-api-access-d8kp7") pod "d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" (UID: "d1f6bbfe-192a-4c98-9b83-48cf6d8b185d"). InnerVolumeSpecName "kube-api-access-d8kp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:20.733008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.732909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:20.777914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.777879    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8kp7\" (UniqueName: \"kubernetes.io/projected/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-kube-api-access-d8kp7\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.777914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.777909    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d-plugins-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.777914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.777919    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hdkb\" (UniqueName: \"kubernetes.io/projected/ca0a042a-9f0d-46b9-a5d9-826bc353974d-kube-api-access-7hdkb\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:20.778153 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:20.777929    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca0a042a-9f0d-46b9-a5d9-826bc353974d-plugins-config-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:21.467129 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.467103    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"
Sep 07 21:20:21.467313 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.467142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr" event={"ID":"d1f6bbfe-192a-4c98-9b83-48cf6d8b185d","Type":"ContainerDied","Data":"5376b3e9328fb37fd3b1ef0f335242c6d222c89a33209506c578729dc6839864"}
Sep 07 21:20:21.467313 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.467207    2583 scope.go:117] "RemoveContainer" containerID="183ae8b37c635e4662afe27166aa5b33a42ad331fe19ff4810773c494d31feb5"
Sep 07 21:20:21.468624 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.468605    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"
Sep 07 21:20:21.468689 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.468620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp" event={"ID":"ca0a042a-9f0d-46b9-a5d9-826bc353974d","Type":"ContainerDied","Data":"7841cb81b48c6024fcf8b41b5f970c6e63b2993a36b71b5bb912f81d82094832"}
Sep 07 21:20:21.477208 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.477189    2583 scope.go:117] "RemoveContainer" containerID="de4c84fa681348e2dcb5b09e08ff5aa58420cad24697f047c377401cd35fc88e"
Sep 07 21:20:21.485200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.485171    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:20:21.487665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.487590    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp"]
Sep 07 21:20:21.498199 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.498170    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:20:21.502490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:21.502460    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr"]
Sep 07 21:20:22.463432 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.463394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:22.533780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.533741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:22.677761 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.677719    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" path="/var/lib/kubelet/pods/ca0a042a-9f0d-46b9-a5d9-826bc353974d/volumes"
Sep 07 21:20:22.678128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.678113    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" path="/var/lib/kubelet/pods/d1f6bbfe-192a-4c98-9b83-48cf6d8b185d/volumes"
Sep 07 21:20:22.770963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.770840    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:20:22.771133 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.771111    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy" containerID="cri-o://bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de" gracePeriod=30
Sep 07 21:20:22.781303 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:22.781272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:23.056425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:23.056328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:23.150024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:23.149986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:23.250861 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:23.250825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:26.521129 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:26.521097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:26.587257 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:26.587227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:26.770654 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:26.770616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:27.294710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:27.294676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:27.593284 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:27.593196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:28.020959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.020923    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:20:28.035966 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.035913    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.035997    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036019    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036058    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036118    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x87t2\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036420 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data\") pod \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\" (UID: \"f692ea01-01ce-4ac1-9a34-c047b6a7552f\") "
Sep 07 21:20:28.036573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036431    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:28.036573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036452    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:28.036573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:20:28.036715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:28.036715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036590    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.036715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036609    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.036715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.036629    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data" (OuterVolumeSpecName: "istio-data") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:28.038486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.038446    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:20:28.038486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.038459    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token" (OuterVolumeSpecName: "istio-token") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:28.038750 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.038731    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:20:28.038797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.038752    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2" (OuterVolumeSpecName: "kube-api-access-x87t2") pod "f692ea01-01ce-4ac1-9a34-c047b6a7552f" (UID: "f692ea01-01ce-4ac1-9a34-c047b6a7552f"). InnerVolumeSpecName "kube-api-access-x87t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:20:28.137728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137687    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.137728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137722    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.137728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137735    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.138021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137746    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.138021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137760    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x87t2\" (UniqueName: \"kubernetes.io/projected/f692ea01-01ce-4ac1-9a34-c047b6a7552f-kube-api-access-x87t2\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.138021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137770    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.138021 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.137781    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f692ea01-01ce-4ac1-9a34-c047b6a7552f-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:20:28.342380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.342336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:28.517008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.516975    2583 generic.go:356] "Generic (PLEG): container finished" podID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerID="bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de" exitCode=0
Sep 07 21:20:28.517181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.517019    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"
Sep 07 21:20:28.517181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.517034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerDied","Data":"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"}
Sep 07 21:20:28.517181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.517086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd" event={"ID":"f692ea01-01ce-4ac1-9a34-c047b6a7552f","Type":"ContainerDied","Data":"38172402ff0caa3dc953fa0b6b526e86bcb8aff642500591de55576a350f0d8f"}
Sep 07 21:20:28.517181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.517109    2583 scope.go:117] "RemoveContainer" containerID="bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"
Sep 07 21:20:28.526499 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.526482    2583 scope.go:117] "RemoveContainer" containerID="7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"
Sep 07 21:20:28.534794 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.534775    2583 scope.go:117] "RemoveContainer" containerID="bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"
Sep 07 21:20:28.535109 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:20:28.535085    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de\": container with ID starting with bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de not found: ID does not exist" containerID="bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"
Sep 07 21:20:28.535202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.535116    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de"} err="failed to get container status \"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de\": rpc error: code = NotFound desc = could not find container \"bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de\": container with ID starting with bb2da60e894b87049fbfd63a09d85b8951ae8d4a453d8caa3a213f8ccdeb82de not found: ID does not exist"
Sep 07 21:20:28.535202 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.535136    2583 scope.go:117] "RemoveContainer" containerID="7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"
Sep 07 21:20:28.535378 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:20:28.535353    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513\": container with ID starting with 7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513 not found: ID does not exist" containerID="7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"
Sep 07 21:20:28.535415 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.535382    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513"} err="failed to get container status \"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513\": rpc error: code = NotFound desc = could not find container \"7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513\": container with ID starting with 7ce33a21fd9cc65faa6c8b9af7c2318ddbe8ec8008859e5d2284717533c33513 not found: ID does not exist"
Sep 07 21:20:28.538388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.538362    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:20:28.543131 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.543105    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd"]
Sep 07 21:20:28.677745 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:28.677708    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" path="/var/lib/kubelet/pods/f692ea01-01ce-4ac1-9a34-c047b6a7552f/volumes"
Sep 07 21:20:29.672566 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:29.672528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:29.775478 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:29.775442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:29.878320 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:29.878276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:29.967388 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:29.967296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:30.109595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:30.109561    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:30.211763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:30.211727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:30.287421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:30.287268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:31.282960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.282910    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:20:31.283529 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283508    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" containerName="payload-pre-processing"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283530    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" containerName="payload-pre-processing"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283544    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283552    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283562    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88eb23c8-a266-4777-8585-161e283d11ec" containerName="revoke-keys"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283570    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88eb23c8-a266-4777-8585-161e283d11ec" containerName="revoke-keys"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283584    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283593    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" containerName="payload-processing"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283626    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" containerName="payload-processing"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283726    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f6bbfe-192a-4c98-9b83-48cf6d8b185d" containerName="payload-processing"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283739    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88eb23c8-a266-4777-8585-161e283d11ec" containerName="revoke-keys"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283752    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f692ea01-01ce-4ac1-9a34-c047b6a7552f" containerName="istio-proxy"
Sep 07 21:20:31.283959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.283771    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0a042a-9f0d-46b9-a5d9-826bc353974d" containerName="payload-pre-processing"
Sep 07 21:20:31.288792 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.288759    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.291217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.291194    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nj5g\""
Sep 07 21:20:31.291333 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.291195    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-15d5e2-serving-cert\""
Sep 07 21:20:31.291913 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.291897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:20:31.292086 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.292068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 21:20:31.292167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.292149    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 21:20:31.296620 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.296600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:20:31.318476 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.318441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:31.368341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.368305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.368520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.368363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-726fs\" (UniqueName: \"kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.368520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.368440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.368595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.368530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.422748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.422706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:31.470051 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.470017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.470184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.470071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-726fs\" (UniqueName: \"kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.470184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.470094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.470184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.470145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.470780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.470751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.472612 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.472581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.472714 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.472615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.479354 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.479328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-726fs\" (UniqueName: \"kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs\") pod \"maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.520171 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.520138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:31.603117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.603015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:31.802423 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.802380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:31.880962 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.880924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:20:31.883127 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:31.883091    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a18d56_54e8_4f5d_ab28_6a4ed54c23ca.slice/crio-c6d078fd3ac056164a9f22977bd95d19bc5ea74c6a362cfdab8043e76dc31101 WatchSource:0}: Error finding container c6d078fd3ac056164a9f22977bd95d19bc5ea74c6a362cfdab8043e76dc31101: Status 404 returned error can't find the container with id c6d078fd3ac056164a9f22977bd95d19bc5ea74c6a362cfdab8043e76dc31101
Sep 07 21:20:31.884828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.884806    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:20:31.884928 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:31.884800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:32.539100 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:32.539005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" event={"ID":"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca","Type":"ContainerStarted","Data":"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"}
Sep 07 21:20:32.539100 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:32.539059    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" event={"ID":"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca","Type":"ContainerStarted","Data":"c6d078fd3ac056164a9f22977bd95d19bc5ea74c6a362cfdab8043e76dc31101"}
Sep 07 21:20:32.539521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:32.539130    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:32.556735 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:32.556679    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" podStartSLOduration=1.167725598 podStartE2EDuration="1.556662001s" totalImagesPullingTime="388.936403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:32.554581127 +0000 UTC m=+1144.390707246" watchObservedRunningTime="2026-09-07 21:20:32.556662001 +0000 UTC m=+1144.392788106"
Sep 07 21:20:35.830508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:35.830465    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:35.904791 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:35.904751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:36.756905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:36.756862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:37.028187 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.028094    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:20:37.031596 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.031570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.034152 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.034128    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d03ead-openshift-default-dockercfg-lzzc9\""
Sep 07 21:20:37.034354 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.034340    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 21:20:37.042662 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.042631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:20:37.073365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.073325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:37.126636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.126844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.127119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8sp\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.127119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.126893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228323 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8sp\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228901 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.228901 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.229033 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.228978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.229205 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.229185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.229550 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.229528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.230726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.230705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.231022 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.231006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.236005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.235975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.236115 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.236015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8sp\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp\") pod \"e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") " pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.344987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.344859    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:37.626230 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.626201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:20:37.628116 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:37.628084    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e0f003_b76f_484d_81c1_b15266e5146d.slice/crio-c0e3049abbcac40cfbfc8a57e82ba6e3c06174a2b2aa90902d94bc0d2e2e5063 WatchSource:0}: Error finding container c0e3049abbcac40cfbfc8a57e82ba6e3c06174a2b2aa90902d94bc0d2e2e5063: Status 404 returned error can't find the container with id c0e3049abbcac40cfbfc8a57e82ba6e3c06174a2b2aa90902d94bc0d2e2e5063
Sep 07 21:20:37.630881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.630848    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:37.630980 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.630919    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:37.631027 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:37.630982    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:38.112125 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:38.112081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:38.549591 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:38.549565    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:20:38.571581 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:38.571547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerStarted","Data":"f59193d12c45ea9588dc01fb765f8a5c99840af43bdd027ab3185eb07d5f95e9"}
Sep 07 21:20:38.571753 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:38.571598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerStarted","Data":"c0e3049abbcac40cfbfc8a57e82ba6e3c06174a2b2aa90902d94bc0d2e2e5063"}
Sep 07 21:20:38.594923 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:38.594867    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podStartSLOduration=1.594847913 podStartE2EDuration="1.594847913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:38.592567782 +0000 UTC m=+1150.428693888" watchObservedRunningTime="2026-09-07 21:20:38.594847913 +0000 UTC m=+1150.430974018"
Sep 07 21:20:39.345877 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:39.345831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:39.350981 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:39.350928    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:39.577241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:39.577199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:39.578342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:39.578315    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:40.458254 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:40.458217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:40.552523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:40.552481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:41.585692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.585659    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:20:41.589834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.589808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.591851 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.591827    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-d03ead-serving-cert\""
Sep 07 21:20:41.601965 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.601847    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:20:41.618972 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.618916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:41.672345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.672299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.672573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.672401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.672573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.672420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9nkx\" (UniqueName: \"kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.672573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.672558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.723903 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.723856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:41.773136 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.773096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.773136 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.773137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nkx\" (UniqueName: \"kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.773418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.773196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.773418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.773230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.773898 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.773868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.775690 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.775668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.775803 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.775720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.785626 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.785592    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9nkx\" (UniqueName: \"kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx\") pod \"maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:41.866384 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.866292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:41.905542 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:41.905497    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:42.140078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:42.139968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:42.183107 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:42.183081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:20:42.184431 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:42.184406    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412584a0_3ca4_445b_b273_c6920a055373.slice/crio-8dabf3f8f47c4bfc3b8af80ba056102c01e5ac0babcba0c83a2348d5c8bbe47e WatchSource:0}: Error finding container 8dabf3f8f47c4bfc3b8af80ba056102c01e5ac0babcba0c83a2348d5c8bbe47e: Status 404 returned error can't find the container with id 8dabf3f8f47c4bfc3b8af80ba056102c01e5ac0babcba0c83a2348d5c8bbe47e
Sep 07 21:20:42.244087 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:42.244056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:42.596905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:42.596869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" event={"ID":"412584a0-3ca4-445b-b273-c6920a055373","Type":"ContainerStarted","Data":"8dabf3f8f47c4bfc3b8af80ba056102c01e5ac0babcba0c83a2348d5c8bbe47e"}
Sep 07 21:20:43.604742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:43.604706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" event={"ID":"412584a0-3ca4-445b-b273-c6920a055373","Type":"ContainerStarted","Data":"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"}
Sep 07 21:20:43.605167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:43.604772    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:43.622010 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:43.621961    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" podStartSLOduration=2.2723500039999998 podStartE2EDuration="2.621925803s" totalImagesPullingTime="349.575799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:43.619967544 +0000 UTC m=+1155.456093650" watchObservedRunningTime="2026-09-07 21:20:43.621925803 +0000 UTC m=+1155.458051907"
Sep 07 21:20:49.623333 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:49.623293    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:20:52.208427 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:52.208373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:55.122692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.122639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:55.235191 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.234869    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:38110->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Sep 07 21:20:55.235191 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.234984    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:38110->10.132.0.58:15021: read: connection reset by peer"
Sep 07 21:20:55.444031 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.443990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:55.677102 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.677067    2583 generic.go:356] "Generic (PLEG): container finished" podID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerID="f59193d12c45ea9588dc01fb765f8a5c99840af43bdd027ab3185eb07d5f95e9" exitCode=0
Sep 07 21:20:55.677290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.677141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerDied","Data":"f59193d12c45ea9588dc01fb765f8a5c99840af43bdd027ab3185eb07d5f95e9"}
Sep 07 21:20:55.677598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.677581    2583 scope.go:117] "RemoveContainer" containerID="f59193d12c45ea9588dc01fb765f8a5c99840af43bdd027ab3185eb07d5f95e9"
Sep 07 21:20:55.678675 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.678645    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:55.678783 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.678729    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:55.678845 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.678779    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:55.726913 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.726877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:20:55.732407 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.732375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.734918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.734892    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7fa21f-openshift-default-dockercfg-82jnk\""
Sep 07 21:20:55.742048 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.742022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:20:55.759832 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.759799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:55.914676 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.914676 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.914963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.914963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.914963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.915098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.914982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgfqc\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.915098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.915003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.915098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.915020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.915222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.915144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:55.966025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:55.965984    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:56.016365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgfqc\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016625 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.016787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.017010 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.016866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.017083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.017038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.017137 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.017107    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.017191 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.017139    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.019084 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.019054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.019241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.019189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.024362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.024331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.024923 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.024900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgfqc\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc\") pod \"e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") " pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.054459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.054420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:56.364969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.364910    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:20:56.367113 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:20:56.367075    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7deca7_346e_493e_adba_411dadda3a08.slice/crio-1820db58d8738134b8d966ae0d81b05611d336e7921b7334817116cea49fce60 WatchSource:0}: Error finding container 1820db58d8738134b8d966ae0d81b05611d336e7921b7334817116cea49fce60: Status 404 returned error can't find the container with id 1820db58d8738134b8d966ae0d81b05611d336e7921b7334817116cea49fce60
Sep 07 21:20:56.369543 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.369510    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:56.369635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.369576    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:56.369635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.369608    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:20:56.685723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.685677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerStarted","Data":"2a45c82b367f53d3cfc5f836917fb3275201a44d27793208dd6253d8e05bba05"}
Sep 07 21:20:56.687426 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.687395    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerStarted","Data":"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"}
Sep 07 21:20:56.687558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:56.687441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerStarted","Data":"1820db58d8738134b8d966ae0d81b05611d336e7921b7334817116cea49fce60"}
Sep 07 21:20:57.055372 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.055262    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:57.060587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.060557    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:57.079888 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.079825    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podStartSLOduration=2.079803637 podStartE2EDuration="2.079803637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:20:56.733461446 +0000 UTC m=+1168.569587554" watchObservedRunningTime="2026-09-07 21:20:57.079803637 +0000 UTC m=+1168.915929745"
Sep 07 21:20:57.345455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.345346    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:20:57.345607 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.345587    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:20:57.345650 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.345635    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 07 21:20:57.693159 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.693122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:57.694180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:57.694156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:20:58.345349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:58.345305    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:20:58.345557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:58.345368    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 07 21:20:58.634651 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:58.634550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:58.725925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:58.725875    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:59.345871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:59.345833    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:20:59.346079 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:59.345908    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 07 21:20:59.774361 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:59.774318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:20:59.872244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:20:59.872209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:00.007063 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:00.006972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:00.345914 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:00.345875    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:21:00.346113 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:00.345971    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 07 21:21:00.360279 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:00.360245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:00.453886 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:00.453837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:01.346006 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:01.345965    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 07 21:21:01.346418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:01.346024    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 07 21:21:02.349520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:02.349487    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:21:02.349911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:02.349864    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:21:02.350679 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:02.350658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:21:02.629729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:02.629625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:05.384528 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.384488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:05.698467 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.698422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:05.968455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.968373    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:21:05.972210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.972185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:05.974457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.974435    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b9edc3-openshift-default-dockercfg-56669\""
Sep 07 21:21:05.982198 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.982174    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:21:05.995289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:05.995253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:06.124821 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.124761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.124911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.124962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.124991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.125047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqxr\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125316 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.125078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125316 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.125126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125316 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.125155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.125316 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.125193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.226316 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.226199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.226594 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.226567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.226755 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.226738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.226877 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.226862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.227124 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.227107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.227255 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.227238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.227369 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.227346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.227516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.227498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqxr\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.227629 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.227615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.228211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.228189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.228601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.228582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.229370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.229347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.229608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.229586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.230529 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.230503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.231804 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.231775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.233179 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.233155    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.237009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.236959    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqxr\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.237430 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.237404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token\") pod \"e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") " pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.284210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.284165    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:06.581365 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.581338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:21:06.586913 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.586869    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:06.587056 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.586975    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:06.587056 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.587007    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:06.723797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.723754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:06.763763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.763728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerStarted","Data":"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"}
Sep 07 21:21:06.763960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.763778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerStarted","Data":"2df90f77b28aa9f40fc091cff2c2adad2ffb95d92cc7344a2bf7ae5bff44792c"}
Sep 07 21:21:06.783998 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:06.783896    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podStartSLOduration=1.783878538 podStartE2EDuration="1.783878538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:06.781726329 +0000 UTC m=+1178.617852436" watchObservedRunningTime="2026-09-07 21:21:06.783878538 +0000 UTC m=+1178.620004643"
Sep 07 21:21:07.285025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:07.284988    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:07.286593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:07.286570    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:07.286726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:07.286707    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:08.289519 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:08.289479    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:08.663196 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:08.663160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:08.760807 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:08.760758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:08.778135 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:08.778107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:08.779246 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:08.779224    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:09.834875 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:09.834836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:09.930347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:09.930309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:10.277252 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:10.277214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:10.379539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:10.379481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:13.734176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:13.734132    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 21:21:13.734598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:13.734224    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 21:21:14.822536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.821144    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a7deca7-346e-493e-adba-411dadda3a08" containerID="f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5" exitCode=0
Sep 07 21:21:14.822536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.821333    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerDied","Data":"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"}
Sep 07 21:21:14.822536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.821856    2583 scope.go:117] "RemoveContainer" containerID="f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"
Sep 07 21:21:14.825069 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.825030    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:14.825411 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.825361    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:14.825626 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:14.825603    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:15.831026 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:15.830979    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerStarted","Data":"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"}
Sep 07 21:21:16.055546 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:16.055505    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:21:16.055893 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:16.055871    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:16.055959 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:16.055918    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:17.055187 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:17.055138    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:17.055697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:17.055213    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:18.054883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:18.054836    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:18.055096 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:18.054896    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:19.057510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:19.055036    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:19.057510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:19.055127    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:20.055039 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:20.054987    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:20.055242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:20.055073    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:20.738504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:20.738460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:21.055565 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:21.055473    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 07 21:21:21.055725 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:21.055556    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 07 21:21:22.059587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:22.059551    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:21:22.060054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:22.059863    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:21:22.060791 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:22.060771    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:21:23.584249 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.584212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:23.780178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.780093    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:23.780178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.780157    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:23.887376 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.887336    2583 generic.go:356] "Generic (PLEG): container finished" podID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerID="63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4" exitCode=0
Sep 07 21:21:23.887549 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.887408    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerDied","Data":"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"}
Sep 07 21:21:23.889353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.889112    2583 scope.go:117] "RemoveContainer" containerID="63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"
Sep 07 21:21:23.897318 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.897269    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:23.897471 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.897360    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:23.897471 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:23.897418    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:24.894355 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:24.894317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerStarted","Data":"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"}
Sep 07 21:21:25.285303 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:25.285255    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:25.285537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:25.285518    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:25.285590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:25.285571    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:26.284649 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:26.284605    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:26.285109 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:26.284667    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:27.285376 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:27.285337    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:27.285777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:27.285399    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:28.285172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:28.285132    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:28.285368 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:28.285208    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:28.735105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:28.735075    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:21:28.736856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:28.736836    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:21:29.285210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:29.285162    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 07 21:21:29.285381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:29.285228    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 07 21:21:30.288848 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:30.288809    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:30.289351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:30.289245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:30.290124 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:30.290105    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:21:31.599352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:31.599309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:33.627025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:33.626987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:42.375867 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:42.375823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:46.621870 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.621827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:46.902738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.902638    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:21:46.908563 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.908533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:46.911000 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.910973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-424fbbc4-openshift-default-dockercfg-sdww6\""
Sep 07 21:21:46.915426 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.915394    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:21:46.922559 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:46.922525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:47.059314 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2827m\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.059824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.059782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2827m\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161487 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161802 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161802 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.161907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.161843    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.162048 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.162024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.162122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.162050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.162122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.162064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.163755 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.163731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.164027 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.164008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.169264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.169231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.169401 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.169304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2827m\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m\") pod \"e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") " pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.187147 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.187114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:47.221799 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.221759    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:47.504586 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.504548    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:21:47.507461 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:21:47.507427    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289279f7_c778_4a8d_9296_27ec4c93d88d.slice/crio-00b9bce20544a7da7e724ca1d276dc6800cb3b9f04b0cd94a83602e6a80e92b5 WatchSource:0}: Error finding container 00b9bce20544a7da7e724ca1d276dc6800cb3b9f04b0cd94a83602e6a80e92b5: Status 404 returned error can't find the container with id 00b9bce20544a7da7e724ca1d276dc6800cb3b9f04b0cd94a83602e6a80e92b5
Sep 07 21:21:47.510143 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.510105    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:47.510236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.510188    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:47.510236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:47.510215    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:21:48.041310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:48.041272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerStarted","Data":"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"}
Sep 07 21:21:48.041837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:48.041331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerStarted","Data":"00b9bce20544a7da7e724ca1d276dc6800cb3b9f04b0cd94a83602e6a80e92b5"}
Sep 07 21:21:48.061409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:48.061344    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podStartSLOduration=2.061324416 podStartE2EDuration="2.061324416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:21:48.058645231 +0000 UTC m=+1219.894771338" watchObservedRunningTime="2026-09-07 21:21:48.061324416 +0000 UTC m=+1219.897450521"
Sep 07 21:21:48.222905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:48.222865    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:48.228700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:48.228671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:49.047317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:49.047285    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:49.048417 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:49.048399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:21:49.941654 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:49.941605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:50.037762 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:50.037724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:51.082695 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:51.082649    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:51.142995 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:51.142956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:51.250301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:51.250264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:51.584406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:51.584355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:21:51.651308 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:21:51.651251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:08.172400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.172360    2583 generic.go:356] "Generic (PLEG): container finished" podID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerID="98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77" exitCode=0
Sep 07 21:22:08.172831 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.172429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerDied","Data":"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"}
Sep 07 21:22:08.172876 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.172843    2583 scope.go:117] "RemoveContainer" containerID="98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"
Sep 07 21:22:08.174008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.173972    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:22:08.174112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.174048    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:22:08.174112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:08.174084    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:22:09.180407 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:09.180364    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerStarted","Data":"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"}
Sep 07 21:22:09.222798 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:09.222748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:22:09.223045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:09.222890    2583 patch_prober.go:28] interesting pod/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 07 21:22:09.223045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:09.222979    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 07 21:22:10.222827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:10.222780    2583 patch_prober.go:28] interesting pod/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 07 21:22:10.223349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:10.222875    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 07 21:22:11.222884 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:11.222846    2583 patch_prober.go:28] interesting pod/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 07 21:22:11.223375 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:11.223010    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 07 21:22:12.222728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:12.222679    2583 patch_prober.go:28] interesting pod/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 07 21:22:12.222964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:12.222756    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 07 21:22:13.223250 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:13.223180    2583 patch_prober.go:28] interesting pod/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 07 21:22:13.223778 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:13.223279    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 07 21:22:14.428006 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:14.427965    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:22:14.428516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:14.428413    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:22:14.429331 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:14.429309    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:22:14.916425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:14.916373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:14.976346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:14.976240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:25.780433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:25.780355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:29.347567 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:29.347527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:33.254048 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.254009    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:22:33.257912 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.257887    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.260237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.260213    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-424fbbc4\"/\"kube-root-ca.crt\""
Sep 07 21:22:33.260978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.260927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-424fbbc4\"/\"default-dockercfg-lqdqg\""
Sep 07 21:22:33.261117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.260952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-424fbbc4\"/\"openshift-service-ca.crt\""
Sep 07 21:22:33.261117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.261018    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-424fbbc4\"/\"e2e-lifecycle-model-424fbbc4-kserve-self-signed-certs\""
Sep 07 21:22:33.267069 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.267043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:22:33.280733 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.280698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:22:33.337245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337204    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk7qv\" (UniqueName: \"kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.337428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.337428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.337428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.337428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.337569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.337454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.438878 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.438829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk7qv\" (UniqueName: \"kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.438969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439499    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.439608 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.439591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.441356 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.441336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.441623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.441603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.446849 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.446825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk7qv\" (UniqueName: \"kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv\") pod \"e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") " pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.569509 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.569412    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:33.844436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:33.844411    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:22:33.846809 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:22:33.846777    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c528862_bcaf_4dd4_b1d8_c41269cb1b8c.slice/crio-e08c5e2be5f7ced9290d36af2281b7d68fa1dcd3af25529af644991a33b58377 WatchSource:0}: Error finding container e08c5e2be5f7ced9290d36af2281b7d68fa1dcd3af25529af644991a33b58377: Status 404 returned error can't find the container with id e08c5e2be5f7ced9290d36af2281b7d68fa1dcd3af25529af644991a33b58377
Sep 07 21:22:34.326633 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:34.326589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" event={"ID":"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c","Type":"ContainerStarted","Data":"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"}
Sep 07 21:22:34.327070 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:34.326646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" event={"ID":"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c","Type":"ContainerStarted","Data":"e08c5e2be5f7ced9290d36af2281b7d68fa1dcd3af25529af644991a33b58377"}
Sep 07 21:22:34.345738 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:34.345679    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" podStartSLOduration=1.345660474 podStartE2EDuration="1.345660474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:22:34.343777559 +0000 UTC m=+1266.179903665" watchObservedRunningTime="2026-09-07 21:22:34.345660474 +0000 UTC m=+1266.181786633"
Sep 07 21:22:43.570128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:43.570078    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:43.570128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:43.570137    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:43.582759 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:43.582729    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:22:44.400005 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:22:44.399965    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:23:00.672029 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:00.671985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:09.817817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:09.817757    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:10.293152 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:10.293117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.176239 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.176198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.244344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.244294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.306773 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.306737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.376181 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.376126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.432883 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.432791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:25.543080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:25.543042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:28.394865 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:28.394829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:33.381186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:33.381153    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:23:33.423526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:33.423495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:23:48.404024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.403977    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" podUID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" containerName="main" containerID="cri-o://f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e" gracePeriod=45
Sep 07 21:23:48.650750 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.650722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:23:48.710983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.710931    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711033    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711088    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk7qv\" (UniqueName: \"kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711142    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home" (OuterVolumeSpecName: "home") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:23:48.711186 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711231    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs\") pod \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\" (UID: \"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c\") "
Sep 07 21:23:48.711457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711316    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:23:48.711457 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711329    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:23:48.711746 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711703    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-model-cache\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:48.711746 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711738    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-home\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:48.711889 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.711752    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tmp-dir\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:48.713425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.713401    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm" (OuterVolumeSpecName: "dshm") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:23:48.713569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.713547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:23:48.713627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.713571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv" (OuterVolumeSpecName: "kube-api-access-gk7qv") pod "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" (UID: "3c528862-bcaf-4dd4-b1d8-c41269cb1b8c"). InnerVolumeSpecName "kube-api-access-gk7qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:23:48.756431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.756394    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" containerID="f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e" exitCode=0
Sep 07 21:23:48.756557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.756451    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"
Sep 07 21:23:48.756557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.756491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" event={"ID":"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c","Type":"ContainerDied","Data":"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"}
Sep 07 21:23:48.756557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.756549    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv" event={"ID":"3c528862-bcaf-4dd4-b1d8-c41269cb1b8c","Type":"ContainerDied","Data":"e08c5e2be5f7ced9290d36af2281b7d68fa1dcd3af25529af644991a33b58377"}
Sep 07 21:23:48.757019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.756571    2583 scope.go:117] "RemoveContainer" containerID="f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"
Sep 07 21:23:48.766595 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.766579    2583 scope.go:117] "RemoveContainer" containerID="f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"
Sep 07 21:23:48.766844 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:23:48.766824    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e\": container with ID starting with f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e not found: ID does not exist" containerID="f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"
Sep 07 21:23:48.766907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.766850    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e"} err="failed to get container status \"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e\": rpc error: code = NotFound desc = could not find container \"f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e\": container with ID starting with f8f6a5d36929c1c0f172edfe0d4e8b582ffd6ce332892ea831e181b207b8011e not found: ID does not exist"
Sep 07 21:23:48.776669 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.776650    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:23:48.782231 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.782209    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-424fbbc4/e2e-lifecycle-model-424fbbc4-kserve-5f59f96467-cvwmv"]
Sep 07 21:23:48.812571 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.812543    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk7qv\" (UniqueName: \"kubernetes.io/projected/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-kube-api-access-gk7qv\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:48.812571 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.812565    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-dshm\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:48.812699 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:48.812575    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c-tls-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:23:50.677206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:23:50.677176    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" path="/var/lib/kubelet/pods/3c528862-bcaf-4dd4-b1d8-c41269cb1b8c/volumes"
Sep 07 21:24:10.280194 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:10.280158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:10.421163 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:10.421120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:16.106436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:16.106395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:16.206628 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:16.206586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:16.346290 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:16.346256    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:24:16.346560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:16.346525    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy" containerID="cri-o://2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f" gracePeriod=30
Sep 07 21:24:16.362997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:16.362876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:17.651516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:17.651475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:17.750277 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:17.750238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:17.850866 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:17.850830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:18.435197 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:18.435151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:18.531504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:18.531466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:18.630609 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:18.630575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:19.837754 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:19.837724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:21.610026 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.609954    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:24:21.646737 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2827m\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.646934 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646775    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.646934 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646812    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.646934 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646851    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.646934 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646931    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.647207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.646988    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.647207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647039    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.647207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.647207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647155    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data\") pod \"289279f7-c778-4a8d-9296-27ec4c93d88d\" (UID: \"289279f7-c778-4a8d-9296-27ec4c93d88d\") "
Sep 07 21:24:21.647431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647318    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:24:21.647492 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647464    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647591    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647710    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data" (OuterVolumeSpecName: "istio-data") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647746    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647766    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647781    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.647815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.647795    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/289279f7-c778-4a8d-9296-27ec4c93d88d-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.649575 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.649543    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token" (OuterVolumeSpecName: "istio-token") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:24:21.649702 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.649575    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:24:21.649963 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.649920    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:24:21.650057 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.649922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m" (OuterVolumeSpecName: "kube-api-access-2827m") pod "289279f7-c778-4a8d-9296-27ec4c93d88d" (UID: "289279f7-c778-4a8d-9296-27ec4c93d88d"). InnerVolumeSpecName "kube-api-access-2827m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:24:21.748601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.748541    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2827m\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-kube-api-access-2827m\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.748601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.748592    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.748601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.748601    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.748601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.748609    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.748601 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.748617    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/289279f7-c778-4a8d-9296-27ec4c93d88d-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:24:21.941068 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.941032    2583 generic.go:356] "Generic (PLEG): container finished" podID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerID="2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f" exitCode=0
Sep 07 21:24:21.941251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.941088    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"
Sep 07 21:24:21.941251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.941113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerDied","Data":"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"}
Sep 07 21:24:21.941251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.941175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk" event={"ID":"289279f7-c778-4a8d-9296-27ec4c93d88d","Type":"ContainerDied","Data":"00b9bce20544a7da7e724ca1d276dc6800cb3b9f04b0cd94a83602e6a80e92b5"}
Sep 07 21:24:21.941251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.941207    2583 scope.go:117] "RemoveContainer" containerID="2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"
Sep 07 21:24:21.953289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.953268    2583 scope.go:117] "RemoveContainer" containerID="98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"
Sep 07 21:24:21.962398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.962370    2583 scope.go:117] "RemoveContainer" containerID="2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"
Sep 07 21:24:21.962698 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:24:21.962676    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f\": container with ID starting with 2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f not found: ID does not exist" containerID="2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"
Sep 07 21:24:21.962769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.962709    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f"} err="failed to get container status \"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f\": rpc error: code = NotFound desc = could not find container \"2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f\": container with ID starting with 2d182956c30041e5bfd6ef7b529b87d822c7d5f89497a44a4aaa8a2ef375f45f not found: ID does not exist"
Sep 07 21:24:21.962769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.962727    2583 scope.go:117] "RemoveContainer" containerID="98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"
Sep 07 21:24:21.963019 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:24:21.962996    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77\": container with ID starting with 98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77 not found: ID does not exist" containerID="98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"
Sep 07 21:24:21.963069 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.963037    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77"} err="failed to get container status \"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77\": rpc error: code = NotFound desc = could not find container \"98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77\": container with ID starting with 98fd577c72a3fa1eeeeea2db585146b5e458422a8a9cedbbd7a2537eab20cd77 not found: ID does not exist"
Sep 07 21:24:21.963919 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.963899    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:24:21.967302 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:21.967280    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk"]
Sep 07 21:24:22.677128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:22.677096    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" path="/var/lib/kubelet/pods/289279f7-c778-4a8d-9296-27ec4c93d88d/volumes"
Sep 07 21:24:25.736770 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:25.736737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:25.793845 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:25.793812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:26.424815 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:26.424776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:30.971230 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:30.971194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:32.084066 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:32.084027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:32.144114 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:32.144059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:32.223366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:32.223328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:32.321852 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:32.321808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:38.273190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:38.273144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:39.271061 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:39.271026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:42.752588 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:42.752553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:42.966636 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:42.966597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:24:44.966165 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:24:44.966131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:03.884997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:03.884958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:08.493508 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:08.493464    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:09.778822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:09.778789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:09.912075 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:09.912029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:10.078726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.078635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:10.360853 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.360776    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:25:10.361266 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361242    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:10.361266 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361264    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:10.361505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361280    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" containerName="main"
Sep 07 21:25:10.361505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361287    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" containerName="main"
Sep 07 21:25:10.361505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361379    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:10.361505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.361393    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c528862-bcaf-4dd4-b1d8-c41269cb1b8c" containerName="main"
Sep 07 21:25:10.364667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.364648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.366953 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.366924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4cf126-openshift-default-dockercfg-sqldn\""
Sep 07 21:25:10.375180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.375159    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:25:10.388324 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.388301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:10.438666 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.438989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.438969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdhk4\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.539817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.539782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.539817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.539818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540036 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.539836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540150    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540349 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540453 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdhk4\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540506 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.540827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.541156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.540925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.542348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.542325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.542484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.542468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.547537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.547508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdhk4\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.547660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.547642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token\") pod \"e2e-api-a-4cf126-openshift-default-78bc667884-grpnh\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") " pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.676717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.676686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:10.832995 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.832926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:10.954289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.954259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:25:10.955612 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:25:10.955585    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6278e0a_0345_452b_8a65_5b9c659247be.slice/crio-cc14f4927e8e461cd84dde735fa79956b1c531275f107368bfc69592f032a234 WatchSource:0}: Error finding container cc14f4927e8e461cd84dde735fa79956b1c531275f107368bfc69592f032a234: Status 404 returned error can't find the container with id cc14f4927e8e461cd84dde735fa79956b1c531275f107368bfc69592f032a234
Sep 07 21:25:10.957979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.957923    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:10.958062 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.958023    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:10.958101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:10.958062    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:11.236964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:11.236854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerStarted","Data":"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"}
Sep 07 21:25:11.236964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:11.236928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerStarted","Data":"cc14f4927e8e461cd84dde735fa79956b1c531275f107368bfc69592f032a234"}
Sep 07 21:25:11.255029 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:11.254977    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podStartSLOduration=1.254962677 podStartE2EDuration="1.254962677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:11.253650782 +0000 UTC m=+1423.089776889" watchObservedRunningTime="2026-09-07 21:25:11.254962677 +0000 UTC m=+1423.091088781"
Sep 07 21:25:11.676799 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:11.676768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:12.682503 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:12.682473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:13.156523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:13.156495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:13.247997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:13.247935    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:13.248806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:13.248783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:13.258460 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:13.258436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:14.447887 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:14.447851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:14.548950 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:14.548918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:14.648651 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:14.648616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:15.134873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:15.134843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:15.234526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:15.234487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:29.289171 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:29.289128    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 21:25:29.289556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:29.289205    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 21:25:31.359069 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.359034    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6278e0a-0345-452b-8a65-5b9c659247be" containerID="8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d" exitCode=0
Sep 07 21:25:31.359483 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.359107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerDied","Data":"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"}
Sep 07 21:25:31.359535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.359513    2583 scope.go:117] "RemoveContainer" containerID="8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"
Sep 07 21:25:31.360663 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.360636    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:31.360728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.360703    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:31.360780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:31.360734    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:32.366106 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:32.366073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerStarted","Data":"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"}
Sep 07 21:25:32.679598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:32.679563    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:32.679800 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:32.679626    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:32.683795 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:32.683768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:33.677606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:33.677570    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:33.678079 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:33.677629    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:34.677627 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:34.677596    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:34.678028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:34.677656    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:35.677726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:35.677683    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:35.678215 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:35.677759    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:36.677910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:36.677874    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:36.678304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:36.677930    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:37.679165 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:37.679130    2583 patch_prober.go:28] interesting pod/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 07 21:25:37.679563 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:37.679186    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 07 21:25:38.096805 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.096648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:38.546298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.546261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:38.680299 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.680271    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:38.680723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.680655    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:38.681428 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.681410    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:25:38.848585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.848512    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:25:38.848961 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.848933    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:38.848961 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.848960    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:38.849045 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.849034    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="289279f7-c778-4a8d-9296-27ec4c93d88d" containerName="istio-proxy"
Sep 07 21:25:38.852385 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.852325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.854604 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.854579    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8f54f1-openshift-default-dockercfg-vvb74\""
Sep 07 21:25:38.863143 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.863116    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:25:38.882607 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.882576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:38.927715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5p9m\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.927987 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927935    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.928110 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.927987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:38.928110 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:38.928012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.028703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.028669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.028891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.028821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.028891 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.028859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.028923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.028973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5p9m\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029337 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029511 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029489    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029758    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.029907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.029839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.031711 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.031684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.031809 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.031762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.036824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.036804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.037518 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.037488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5p9m\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m\") pod \"e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") " pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.061950 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.061903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:39.164574 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.164538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:39.442425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.442370    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:25:39.444779 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:25:39.444750    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ec3abc_26f1_4cba_9971_f00e3104f9b6.slice/crio-889e6eb60d6c4ee751b7409d44f367a86bcfe5d9c831520718ea7c81fa0fe677 WatchSource:0}: Error finding container 889e6eb60d6c4ee751b7409d44f367a86bcfe5d9c831520718ea7c81fa0fe677: Status 404 returned error can't find the container with id 889e6eb60d6c4ee751b7409d44f367a86bcfe5d9c831520718ea7c81fa0fe677
Sep 07 21:25:39.447060 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.447022    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:39.447189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.447086    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:39.447189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:39.447117    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:25:40.418199 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:40.418153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerStarted","Data":"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"}
Sep 07 21:25:40.418600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:40.418227    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerStarted","Data":"889e6eb60d6c4ee751b7409d44f367a86bcfe5d9c831520718ea7c81fa0fe677"}
Sep 07 21:25:40.438168 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:40.438121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podStartSLOduration=2.438107507 podStartE2EDuration="2.438107507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:40.435820019 +0000 UTC m=+1452.271946124" watchObservedRunningTime="2026-09-07 21:25:40.438107507 +0000 UTC m=+1452.274233669"
Sep 07 21:25:41.165550 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:41.165516    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:41.170692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:41.170666    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:41.428056 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:41.425271    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:41.431771 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:41.431746    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:25:42.306273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:42.306229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:42.402537 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:42.402497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:43.409025 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.408996    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:25:43.413775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.413748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.415982 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.415933    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-8f54f1-serving-cert\""
Sep 07 21:25:43.423078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.423055    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:25:43.449200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.449173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:43.474327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.474298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.474438 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.474407    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.474485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.474437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqlnj\" (UniqueName: \"kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.474485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.474471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.505344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.505312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:43.575101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.575072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.575285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.575114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqlnj\" (UniqueName: \"kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.575285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.575147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.575285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.575188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.575587 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:25:43.575561    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-serving-cert: secret "maas-api-e2e-api-b-8f54f1-serving-cert" not found
Sep 07 21:25:43.575690 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:25:43.575640    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls podName:8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8 nodeName:}" failed. No retries permitted until 2026-09-07 21:25:44.075617274 +0000 UTC m=+1455.911743377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls") pod "maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8") : secret "maas-api-e2e-api-b-8f54f1-serving-cert" not found
Sep 07 21:25:43.575927 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.575907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.577455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.577433    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:43.582092 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:43.582072    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqlnj\" (UniqueName: \"kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:44.028707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:44.028673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:44.079557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:44.079525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:44.079730 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:25:44.079686    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-serving-cert: secret "maas-api-e2e-api-b-8f54f1-serving-cert" not found
Sep 07 21:25:44.079777 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:25:44.079758    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls podName:8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8 nodeName:}" failed. No retries permitted until 2026-09-07 21:25:45.079743257 +0000 UTC m=+1456.915869340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls") pod "maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8") : secret "maas-api-e2e-api-b-8f54f1-serving-cert" not found
Sep 07 21:25:44.126845 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:44.126805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:44.276239 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:44.276210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:25:45.089341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:45.089308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:45.091513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:45.091491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:45.232037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:45.232001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:45.508505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:45.508481    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:25:45.510117 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:25:45.510080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cee6a52_e6f9_41e0_ac95_5cfd32ff49c8.slice/crio-8f62d46729404a3c094029234ee81cce6947c6369af6860397250f980518c824 WatchSource:0}: Error finding container 8f62d46729404a3c094029234ee81cce6947c6369af6860397250f980518c824: Status 404 returned error can't find the container with id 8f62d46729404a3c094029234ee81cce6947c6369af6860397250f980518c824
Sep 07 21:25:45.511656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:45.511633    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:25:46.454016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:46.453977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" event={"ID":"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8","Type":"ContainerStarted","Data":"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"}
Sep 07 21:25:46.454459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:46.454043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" event={"ID":"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8","Type":"ContainerStarted","Data":"8f62d46729404a3c094029234ee81cce6947c6369af6860397250f980518c824"}
Sep 07 21:25:46.454459 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:46.454074    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:46.469348 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:46.469306    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" podStartSLOduration=3.070815431 podStartE2EDuration="3.469292051s" totalImagesPullingTime="398.47662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:25:46.467404492 +0000 UTC m=+1458.303530575" watchObservedRunningTime="2026-09-07 21:25:46.469292051 +0000 UTC m=+1458.305418157"
Sep 07 21:25:52.465211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:52.465176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:25:52.860393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:25:52.860291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:03.280310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:03.280270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:04.447333 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:04.447289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:07.252665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.252618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:07.576255 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.576180    2583 generic.go:356] "Generic (PLEG): container finished" podID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerID="f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010" exitCode=0
Sep 07 21:26:07.576435 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.576247    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerDied","Data":"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"}
Sep 07 21:26:07.576711 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.576697    2583 scope.go:117] "RemoveContainer" containerID="f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"
Sep 07 21:26:07.577791 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.577762    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:26:07.577850 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.577836    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:26:07.577902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:07.577891    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:26:08.352957 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:08.352914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:08.583460 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:08.583411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerStarted","Data":"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"}
Sep 07 21:26:09.165663 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:09.165620    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:09.166841 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:09.166816    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 07 21:26:09.166964 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:09.166880    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 07 21:26:09.589476 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:09.589389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:10.119029 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:10.118917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:10.165234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:10.165197    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 07 21:26:10.165391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:10.165260    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 07 21:26:11.165326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:11.165291    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 07 21:26:11.165706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:11.165357    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 07 21:26:11.425908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:11.425811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:12.165837 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:12.165801    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 07 21:26:12.166317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:12.165861    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 07 21:26:13.165146 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:13.165111    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 07 21:26:13.165339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:13.165177    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 07 21:26:14.340466 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:14.340418    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:14.342556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:14.342530    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:21.391042 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:21.391005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:25.446176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:25.446142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:25.548407 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:25.548371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:25.625882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:25.625843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:25.677961 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:25.677913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:25.984971 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:25.984920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:28.778128 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:28.778100    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:26:28.780394 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:28.780376    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:26:28.860985 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:28.860935    2583 scope.go:117] "RemoveContainer" containerID="0c8d762db252c766eb3dcad7f537684d6d944e7a936ce43c1c3d76edbb1b03ee"
Sep 07 21:26:28.871336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:28.871306    2583 scope.go:117] "RemoveContainer" containerID="ca39423bf41760d4681b853492e6926c8615c610a655b081261a89536e90a920"
Sep 07 21:26:31.912564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:31.912523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:32.014882 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:32.014844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:32.154703 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:32.154670    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:26:32.154919 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:32.154897    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy" containerID="cri-o://0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4" gracePeriod=30
Sep 07 21:26:32.176162 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:32.176088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:32.344858 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:32.344818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:33.123246 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:33.123208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:37.386286 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.386249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:37.420536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.420478    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:26:37.518216 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518238    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518303    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518436 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518428    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518465    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdhk4\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518544    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.518726 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.518590    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token\") pod \"d6278e0a-0345-452b-8a65-5b9c659247be\" (UID: \"d6278e0a-0345-452b-8a65-5b9c659247be\") "
Sep 07 21:26:37.519293 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.519062    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:37.519425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.519393    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:37.519593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.519568    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:37.519696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.519650    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:37.519796 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.519713    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:37.520916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.520868    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:37.521306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.521268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:37.522993 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.522926    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4" (OuterVolumeSpecName: "kube-api-access-sdhk4") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "kube-api-access-sdhk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:37.523212 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.523179    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6278e0a-0345-452b-8a65-5b9c659247be" (UID: "d6278e0a-0345-452b-8a65-5b9c659247be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:26:37.619933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619898    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.619933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619928    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.619933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619948    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.619933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619958    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.619933 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619966    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6278e0a-0345-452b-8a65-5b9c659247be-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.620242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619975    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6278e0a-0345-452b-8a65-5b9c659247be-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.620242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619983    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.620242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.619993    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdhk4\" (UniqueName: \"kubernetes.io/projected/d6278e0a-0345-452b-8a65-5b9c659247be-kube-api-access-sdhk4\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.620242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.620001    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6278e0a-0345-452b-8a65-5b9c659247be-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:37.771907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.771835    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6278e0a-0345-452b-8a65-5b9c659247be" containerID="0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4" exitCode=0
Sep 07 21:26:37.771907 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.771880    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"
Sep 07 21:26:37.772112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.771923    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerDied","Data":"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"}
Sep 07 21:26:37.772112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.771990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh" event={"ID":"d6278e0a-0345-452b-8a65-5b9c659247be","Type":"ContainerDied","Data":"cc14f4927e8e461cd84dde735fa79956b1c531275f107368bfc69592f032a234"}
Sep 07 21:26:37.772112 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.772021    2583 scope.go:117] "RemoveContainer" containerID="0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"
Sep 07 21:26:37.782310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.782294    2583 scope.go:117] "RemoveContainer" containerID="8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"
Sep 07 21:26:37.790149 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.790135    2583 scope.go:117] "RemoveContainer" containerID="0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"
Sep 07 21:26:37.790545 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:26:37.790510    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4\": container with ID starting with 0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4 not found: ID does not exist" containerID="0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"
Sep 07 21:26:37.790659 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.790548    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4"} err="failed to get container status \"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4\": rpc error: code = NotFound desc = could not find container \"0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4\": container with ID starting with 0d40ea9270645d3784d7e68724ffcd131e78d3df4037bcb1e586d7ee2c3b75c4 not found: ID does not exist"
Sep 07 21:26:37.790659 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.790573    2583 scope.go:117] "RemoveContainer" containerID="8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"
Sep 07 21:26:37.790884 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:26:37.790859    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d\": container with ID starting with 8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d not found: ID does not exist" containerID="8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"
Sep 07 21:26:37.791023 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.790890    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d"} err="failed to get container status \"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d\": rpc error: code = NotFound desc = could not find container \"8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d\": container with ID starting with 8cbc77dbd3c8d1e2bd1090498e01bd2f2be0de3445af2cef45e6d1c156cc493d not found: ID does not exist"
Sep 07 21:26:37.792953 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.792926    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:26:37.799419 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:37.799389    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh"]
Sep 07 21:26:38.677002 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:38.676973    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" path="/var/lib/kubelet/pods/d6278e0a-0345-452b-8a65-5b9c659247be/volumes"
Sep 07 21:26:47.996432 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:47.996398    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:26:47.997016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:47.996653    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" podUID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" containerName="maas-api" containerID="cri-o://aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f" gracePeriod=30
Sep 07 21:26:48.024787 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.024731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.090557 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.090522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.155695 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.155658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.230346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.230285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.252418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.252363    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:26:48.290374 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.290334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.323431 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.323394    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") pod \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") "
Sep 07 21:26:48.323573 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.323497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs\") pod \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") "
Sep 07 21:26:48.323624 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.323574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqlnj\" (UniqueName: \"kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj\") pod \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") "
Sep 07 21:26:48.323624 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.323607    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca\") pod \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\" (UID: \"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8\") "
Sep 07 21:26:48.324178 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.324050    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:48.326071 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.326035    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj" (OuterVolumeSpecName: "kube-api-access-fqlnj") pod "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8"). InnerVolumeSpecName "kube-api-access-fqlnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:48.326185 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.326158    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:26:48.326234 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.326181    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" (UID: "8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:26:48.425044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.425007    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.425044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.425037    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqlnj\" (UniqueName: \"kubernetes.io/projected/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-kube-api-access-fqlnj\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.425044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.425048    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.425273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.425056    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:48.593391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.593310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:48.832966 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.832917    2583 generic.go:356] "Generic (PLEG): container finished" podID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" containerID="aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f" exitCode=0
Sep 07 21:26:48.833166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.832987    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"
Sep 07 21:26:48.833166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.832985    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" event={"ID":"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8","Type":"ContainerDied","Data":"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"}
Sep 07 21:26:48.833166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.833112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm" event={"ID":"8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8","Type":"ContainerDied","Data":"8f62d46729404a3c094029234ee81cce6947c6369af6860397250f980518c824"}
Sep 07 21:26:48.833166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.833137    2583 scope.go:117] "RemoveContainer" containerID="aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"
Sep 07 21:26:48.842264 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.842243    2583 scope.go:117] "RemoveContainer" containerID="aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"
Sep 07 21:26:48.842555 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:26:48.842533    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f\": container with ID starting with aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f not found: ID does not exist" containerID="aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"
Sep 07 21:26:48.842600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.842564    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f"} err="failed to get container status \"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f\": rpc error: code = NotFound desc = could not find container \"aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f\": container with ID starting with aed30ea9c02c420e536d153d4f4df08e001ca2f39aec5a81a8560db09c07dd4f not found: ID does not exist"
Sep 07 21:26:48.850493 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.850434    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:26:48.853881 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:48.853855    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8f54f1-7bc586b5c7-2s2bm"]
Sep 07 21:26:50.677904 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:50.677872    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" path="/var/lib/kubelet/pods/8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8/volumes"
Sep 07 21:26:54.307803 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.307748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:54.407017 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.406984    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:54.549110 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.549078    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:26:54.549381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.549354    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" containerID="cri-o://c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd" gracePeriod=30
Sep 07 21:26:54.572355 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.572279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:54.992921 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:54.992885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:26:59.344217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.344172    2583 patch_prober.go:28] interesting pod/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:26:59.344577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.344290    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:26:59.804707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.804674    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:59.895717 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.895687    2583 generic.go:356] "Generic (PLEG): container finished" podID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerID="c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd" exitCode=0
Sep 07 21:26:59.895905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.895733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerDied","Data":"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"}
Sep 07 21:26:59.895905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.895770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x" event={"ID":"22ec3abc-26f1-4cba-9971-f00e3104f9b6","Type":"ContainerDied","Data":"889e6eb60d6c4ee751b7409d44f367a86bcfe5d9c831520718ea7c81fa0fe677"}
Sep 07 21:26:59.895905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.895793    2583 scope.go:117] "RemoveContainer" containerID="c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"
Sep 07 21:26:59.895905 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.895733    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"
Sep 07 21:26:59.906646 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.906622    2583 scope.go:117] "RemoveContainer" containerID="f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"
Sep 07 21:26:59.915137 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.915116    2583 scope.go:117] "RemoveContainer" containerID="c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"
Sep 07 21:26:59.915460 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:26:59.915439    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd\": container with ID starting with c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd not found: ID does not exist" containerID="c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"
Sep 07 21:26:59.915523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.915471    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd"} err="failed to get container status \"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd\": rpc error: code = NotFound desc = could not find container \"c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd\": container with ID starting with c22b55c7140cb47794b6ba3fd2c8f3939d6d428094f725aa6d59a78718f727fd not found: ID does not exist"
Sep 07 21:26:59.915523 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.915490    2583 scope.go:117] "RemoveContainer" containerID="f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"
Sep 07 21:26:59.915760 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:26:59.915740    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010\": container with ID starting with f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010 not found: ID does not exist" containerID="f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"
Sep 07 21:26:59.915810 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.915767    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010"} err="failed to get container status \"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010\": rpc error: code = NotFound desc = could not find container \"f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010\": container with ID starting with f7f7bfa3d8108d8d1087cd0859c64b9c7af533d552756cd45af40f0e2e49a010 not found: ID does not exist"
Sep 07 21:26:59.943166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943126    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5p9m\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943260    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943343    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943429    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943427    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:59.943616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943462    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.943616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.943520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data\") pod \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\" (UID: \"22ec3abc-26f1-4cba-9971-f00e3104f9b6\") "
Sep 07 21:26:59.944326 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.944292    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:59.944465 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.944344    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:26:59.944465 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.944437    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:59.944597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.944538    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:59.944743 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.944715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:26:59.946666 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.946635    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m" (OuterVolumeSpecName: "kube-api-access-k5p9m") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "kube-api-access-k5p9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:59.953526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.953491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:26:59.953777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.953640    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:26:59.954344 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:26:59.954317    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22ec3abc-26f1-4cba-9971-f00e3104f9b6" (UID: "22ec3abc-26f1-4cba-9971-f00e3104f9b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:27:00.045820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045773    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.045820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045810    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.045820 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045822    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5p9m\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-kube-api-access-k5p9m\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.046093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045833    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.046093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045842    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ec3abc-26f1-4cba-9971-f00e3104f9b6-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.046093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045851    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.046093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045859    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.046093 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.045866    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ec3abc-26f1-4cba-9971-f00e3104f9b6-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:00.221980 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.221930    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:27:00.226450 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.226421    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x"]
Sep 07 21:27:00.679967 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:00.679920    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" path="/var/lib/kubelet/pods/22ec3abc-26f1-4cba-9971-f00e3104f9b6/volumes"
Sep 07 21:27:04.150342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:04.150304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.307282 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.307242    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:27:05.308164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.308109    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" podUID="412584a0-3ca4-445b-b273-c6920a055373" containerName="maas-api" containerID="cri-o://ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b" gracePeriod=30
Sep 07 21:27:05.335105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.335063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.396485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.396443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.497370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.497184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.562653 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.562585    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:27:05.583434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.583286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.705983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.701968    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca\") pod \"412584a0-3ca4-445b-b273-c6920a055373\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") "
Sep 07 21:27:05.705983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.702062    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9nkx\" (UniqueName: \"kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx\") pod \"412584a0-3ca4-445b-b273-c6920a055373\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") "
Sep 07 21:27:05.705983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.702151    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls\") pod \"412584a0-3ca4-445b-b273-c6920a055373\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") "
Sep 07 21:27:05.705983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.702200    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs\") pod \"412584a0-3ca4-445b-b273-c6920a055373\" (UID: \"412584a0-3ca4-445b-b273-c6920a055373\") "
Sep 07 21:27:05.705983 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.705666    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "412584a0-3ca4-445b-b273-c6920a055373" (UID: "412584a0-3ca4-445b-b273-c6920a055373"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:27:05.708486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.707441    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx" (OuterVolumeSpecName: "kube-api-access-f9nkx") pod "412584a0-3ca4-445b-b273-c6920a055373" (UID: "412584a0-3ca4-445b-b273-c6920a055373"). InnerVolumeSpecName "kube-api-access-f9nkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:05.708486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.707478    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "412584a0-3ca4-445b-b273-c6920a055373" (UID: "412584a0-3ca4-445b-b273-c6920a055373"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:27:05.708486 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.707515    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "412584a0-3ca4-445b-b273-c6920a055373" (UID: "412584a0-3ca4-445b-b273-c6920a055373"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:27:05.803833 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.803785    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:05.803833 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.803819    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412584a0-3ca4-445b-b273-c6920a055373-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:05.803833 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.803828    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412584a0-3ca4-445b-b273-c6920a055373-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:05.803833 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.803840    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9nkx\" (UniqueName: \"kubernetes.io/projected/412584a0-3ca4-445b-b273-c6920a055373-kube-api-access-f9nkx\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:05.888908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.888807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:05.930981 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.930921    2583 generic.go:356] "Generic (PLEG): container finished" podID="412584a0-3ca4-445b-b273-c6920a055373" containerID="ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b" exitCode=0
Sep 07 21:27:05.931164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.930985    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"
Sep 07 21:27:05.931164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.931006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" event={"ID":"412584a0-3ca4-445b-b273-c6920a055373","Type":"ContainerDied","Data":"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"}
Sep 07 21:27:05.931164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.931057    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk" event={"ID":"412584a0-3ca4-445b-b273-c6920a055373","Type":"ContainerDied","Data":"8dabf3f8f47c4bfc3b8af80ba056102c01e5ac0babcba0c83a2348d5c8bbe47e"}
Sep 07 21:27:05.931164 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.931080    2583 scope.go:117] "RemoveContainer" containerID="ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"
Sep 07 21:27:05.940778 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.940764    2583 scope.go:117] "RemoveContainer" containerID="ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"
Sep 07 21:27:05.941064 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:27:05.941046    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b\": container with ID starting with ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b not found: ID does not exist" containerID="ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"
Sep 07 21:27:05.941147 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.941072    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b"} err="failed to get container status \"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b\": rpc error: code = NotFound desc = could not find container \"ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b\": container with ID starting with ee77e8350d8bc546be8e9305e6f884f75c6c6a44f673c570757c39c54392e74b not found: ID does not exist"
Sep 07 21:27:05.964918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.964889    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:27:05.974078 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:05.974055    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d03ead-7bff6456f6-qt8dk"]
Sep 07 21:27:06.678230 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:06.678196    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412584a0-3ca4-445b-b273-c6920a055373" path="/var/lib/kubelet/pods/412584a0-3ca4-445b-b273-c6920a055373/volumes"
Sep 07 21:27:11.525505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:11.525469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:11.623517 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:11.623482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:11.753519 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:11.753484    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:27:11.753767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:11.753741    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy" containerID="cri-o://2a45c82b367f53d3cfc5f836917fb3275201a44d27793208dd6253d8e05bba05" gracePeriod=30
Sep 07 21:27:11.763819 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:11.763781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:12.215259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:12.215201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:16.996158 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:16.996124    2583 generic.go:356] "Generic (PLEG): container finished" podID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerID="2a45c82b367f53d3cfc5f836917fb3275201a44d27793208dd6253d8e05bba05" exitCode=0
Sep 07 21:27:16.996558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:16.996196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerDied","Data":"2a45c82b367f53d3cfc5f836917fb3275201a44d27793208dd6253d8e05bba05"}
Sep 07 21:27:16.996558 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:16.996254    2583 scope.go:117] "RemoveContainer" containerID="f59193d12c45ea9588dc01fb765f8a5c99840af43bdd027ab3185eb07d5f95e9"
Sep 07 21:27:17.036023 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.035989    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:27:17.116758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.116758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116763    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116798    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116894    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117009 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.116983    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117037    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:17.117242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117155    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:17.117242 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117177    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117248    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:17.117400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117290    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t8sp\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp\") pod \"b9e0f003-b76f-484d-81c1-b15266e5146d\" (UID: \"b9e0f003-b76f-484d-81c1-b15266e5146d\") "
Sep 07 21:27:17.117400 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117361    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:17.117616 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117404    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:27:17.117680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117636    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.117680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117652    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.117680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117661    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.117680 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117670    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9e0f003-b76f-484d-81c1-b15266e5146d-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.117875 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.117681    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.119244 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.119210    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:17.119357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.119271    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:17.119598 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.119570    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:27:17.119684 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.119589    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp" (OuterVolumeSpecName: "kube-api-access-7t8sp") pod "b9e0f003-b76f-484d-81c1-b15266e5146d" (UID: "b9e0f003-b76f-484d-81c1-b15266e5146d"). InnerVolumeSpecName "kube-api-access-7t8sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:17.218540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.218504    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.218540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.218535    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.218540 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.218545    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t8sp\" (UniqueName: \"kubernetes.io/projected/b9e0f003-b76f-484d-81c1-b15266e5146d-kube-api-access-7t8sp\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:17.218789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:17.218554    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9e0f003-b76f-484d-81c1-b15266e5146d-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:18.003813 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.003783    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"
Sep 07 21:27:18.004238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.003815    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s" event={"ID":"b9e0f003-b76f-484d-81c1-b15266e5146d","Type":"ContainerDied","Data":"c0e3049abbcac40cfbfc8a57e82ba6e3c06174a2b2aa90902d94bc0d2e2e5063"}
Sep 07 21:27:18.004238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.003883    2583 scope.go:117] "RemoveContainer" containerID="2a45c82b367f53d3cfc5f836917fb3275201a44d27793208dd6253d8e05bba05"
Sep 07 21:27:18.024677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.024645    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:27:18.029306 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.029278    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s"]
Sep 07 21:27:18.677387 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:18.677356    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" path="/var/lib/kubelet/pods/b9e0f003-b76f-484d-81c1-b15266e5146d/volumes"
Sep 07 21:27:22.551163 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:22.551129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:22.617827 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:22.617776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:22.717490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:22.717454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:22.805611 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:22.805525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:23.074675 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:23.074566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:28.809201 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:28.809164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:29.040861 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:29.040825    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:27:29.041155 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:29.041110    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" containerID="cri-o://bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8" gracePeriod=30
Sep 07 21:27:29.331806 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:29.331741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:29.793997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:29.793962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:30.152092 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:30.151997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:30.292535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:30.292489    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:27:30.292707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:30.292560    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:27:34.301019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.300993    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:27:34.391288 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391288 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391291    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmqxr\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391339    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391506    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:34.391748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391650    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391683    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data" (OuterVolumeSpecName: "istio-data") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:34.391748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391748 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391738    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy\") pod \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\" (UID: \"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12\") "
Sep 07 21:27:34.391970 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391772    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:34.391970 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391801    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:27:34.392095 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.391986    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:34.392156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.392091    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.392156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.392108    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.392156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.392118    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.392156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.392126    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.392156 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.392133    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.393597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.393568    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:27:34.393706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.393627    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr" (OuterVolumeSpecName: "kube-api-access-kmqxr") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "kube-api-access-kmqxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:34.393706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.393645    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token" (OuterVolumeSpecName: "istio-token") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:27:34.393921 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.393906    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" (UID: "06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:27:34.492623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.492595    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.492623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.492619    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.492623 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.492628    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmqxr\" (UniqueName: \"kubernetes.io/projected/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-kube-api-access-kmqxr\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:34.492825 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:34.492639    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:27:35.092856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.092759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:35.098664 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.098635    2583 generic.go:356] "Generic (PLEG): container finished" podID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerID="bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8" exitCode=0
Sep 07 21:27:35.098817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.098686    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"
Sep 07 21:27:35.098817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.098718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerDied","Data":"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"}
Sep 07 21:27:35.098817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.098779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn" event={"ID":"06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12","Type":"ContainerDied","Data":"2df90f77b28aa9f40fc091cff2c2adad2ffb95d92cc7344a2bf7ae5bff44792c"}
Sep 07 21:27:35.098817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.098806    2583 scope.go:117] "RemoveContainer" containerID="bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"
Sep 07 21:27:35.107924 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.107908    2583 scope.go:117] "RemoveContainer" containerID="63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"
Sep 07 21:27:35.115700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.115676    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:27:35.116083 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.116067    2583 scope.go:117] "RemoveContainer" containerID="bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"
Sep 07 21:27:35.116341 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:27:35.116322    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8\": container with ID starting with bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8 not found: ID does not exist" containerID="bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"
Sep 07 21:27:35.116412 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.116353    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8"} err="failed to get container status \"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8\": rpc error: code = NotFound desc = could not find container \"bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8\": container with ID starting with bcf7439e2be3d95eed3e5d21b12b2af8e6edb27bf3359f0e9b28d0685486bff8 not found: ID does not exist"
Sep 07 21:27:35.116412 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.116379    2583 scope.go:117] "RemoveContainer" containerID="63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"
Sep 07 21:27:35.116649 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:27:35.116628    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4\": container with ID starting with 63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4 not found: ID does not exist" containerID="63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"
Sep 07 21:27:35.116690 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.116655    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4"} err="failed to get container status \"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4\": rpc error: code = NotFound desc = could not find container \"63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4\": container with ID starting with 63793af452597d35364f889d2bbb13502365eb78240d93a45edfaeed1daa42c4 not found: ID does not exist"
Sep 07 21:27:35.122370 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.122347    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn"]
Sep 07 21:27:35.145387 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:35.145354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:36.676906 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:36.676867    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" path="/var/lib/kubelet/pods/06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12/volumes"
Sep 07 21:27:45.043241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:45.043198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:46.063353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.063319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:46.497821 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.497772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:46.781464 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781376    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:27:46.781910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781890    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:46.781910 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781912    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781926    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781934    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781963    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" containerName="maas-api"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781973    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" containerName="maas-api"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.781995    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782003    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782012    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782019    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782036    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412584a0-3ca4-445b-b273-c6920a055373" containerName="maas-api"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782044    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="412584a0-3ca4-445b-b273-c6920a055373" containerName="maas-api"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782054    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782063    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782073    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.782117 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782083    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782204    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782215    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782226    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782236    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782245    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6278e0a-0345-452b-8a65-5b9c659247be" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782258    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cee6a52-e6f9-41e0-ac95-5cfd32ff49c8" containerName="maas-api"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782269    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782279    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="412584a0-3ca4-445b-b273-c6920a055373" containerName="maas-api"
Sep 07 21:27:46.782769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.782286    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ec3abc-26f1-4cba-9971-f00e3104f9b6" containerName="istio-proxy"
Sep 07 21:27:46.787116 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.787096    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.789302 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.789284    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-52269e-openshift-default-dockercfg-qvpdq\""
Sep 07 21:27:46.795814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.795790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:46.797341 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.797318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:27:46.913564 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913665    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm4b6\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913729 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:46.913911 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:46.913827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm4b6\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015393 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015846 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015724    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.015846 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.015805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.016076 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.016029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.016076 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.016066    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.016270 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.016122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.017986 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.017958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.018077 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.018005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.022799 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.022777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.022887 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.022776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm4b6\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6\") pod \"e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") " pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.093398 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.093316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:47.099189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.099161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:47.377513 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.377484    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:27:47.379192 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:27:47.379155    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3973ebfe_09ed_4d6f_a8e1_3a1c7aa8474a.slice/crio-c3a86934eb68c7d0b8e1f92a4e62b9488c2c79b934864caf50f5aa52ab817477 WatchSource:0}: Error finding container c3a86934eb68c7d0b8e1f92a4e62b9488c2c79b934864caf50f5aa52ab817477: Status 404 returned error can't find the container with id c3a86934eb68c7d0b8e1f92a4e62b9488c2c79b934864caf50f5aa52ab817477
Sep 07 21:27:47.381560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.381523    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:27:47.381665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.381599    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:27:47.381665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:47.381627    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:27:48.175425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:48.175384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerStarted","Data":"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"}
Sep 07 21:27:48.175809 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:48.175449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerStarted","Data":"c3a86934eb68c7d0b8e1f92a4e62b9488c2c79b934864caf50f5aa52ab817477"}
Sep 07 21:27:48.196030 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:48.195983    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podStartSLOduration=2.19596883 podStartE2EDuration="2.19596883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:27:48.193902953 +0000 UTC m=+1580.030029083" watchObservedRunningTime="2026-09-07 21:27:48.19596883 +0000 UTC m=+1580.032094932"
Sep 07 21:27:49.099758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:49.099723    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:49.105353 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:49.105316    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:49.180545 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:49.180510    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:49.181421 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:49.181399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:27:50.054605 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:50.054576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:50.154342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:50.154307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:51.286504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:27:51.286887 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286874    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:51.286887 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286888    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a749e8-9dcd-40d6-9a5d-2fdfe04b6b12" containerName="istio-proxy"
Sep 07 21:27:51.286979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286897    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:51.286979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286902    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:51.287044 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.286990    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e0f003-b76f-484d-81c1-b15266e5146d" containerName="istio-proxy"
Sep 07 21:27:51.290214 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.290196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.292494 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.292467    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-52269e-serving-cert\""
Sep 07 21:27:51.302206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.302182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:27:51.324873 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.324847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:51.425709 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.425677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:51.457119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.457084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b779j\" (UniqueName: \"kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.457317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.457219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.457391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.457328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.457391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.457361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.558688 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.558610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.558688 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.558674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.558908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.558692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.558908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.558722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b779j\" (UniqueName: \"kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.559359 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.559334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.561241 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.561214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.561327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.561266    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.571747 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.571721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b779j\" (UniqueName: \"kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j\") pod \"maas-api-e2e-ipp-a-52269e-d75788b-dzrqn\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.601848 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.601812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:51.603706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.603687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:51.878446 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.878418    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:27:51.880610 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:27:51.880582    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b21c9d8_f75c_4bc3_ae74_e99495aa0cef.slice/crio-dbb5283935e99b08b114b4cc8efb490e7195cb90ecd7f6fd6e4c916cd02faea4 WatchSource:0}: Error finding container dbb5283935e99b08b114b4cc8efb490e7195cb90ecd7f6fd6e4c916cd02faea4: Status 404 returned error can't find the container with id dbb5283935e99b08b114b4cc8efb490e7195cb90ecd7f6fd6e4c916cd02faea4
Sep 07 21:27:51.918834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:51.918802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:52.021289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:52.021257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:27:52.197395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:52.197350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" event={"ID":"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef","Type":"ContainerStarted","Data":"dbb5283935e99b08b114b4cc8efb490e7195cb90ecd7f6fd6e4c916cd02faea4"}
Sep 07 21:27:53.204709 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:53.204675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" event={"ID":"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef","Type":"ContainerStarted","Data":"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"}
Sep 07 21:27:53.205175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:53.204738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:27:53.220674 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:53.220615    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" podStartSLOduration=1.882459031 podStartE2EDuration="2.220596288s" totalImagesPullingTime="338.137257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:27:53.219920143 +0000 UTC m=+1585.056046242" watchObservedRunningTime="2026-09-07 21:27:53.220596288 +0000 UTC m=+1585.056722394"
Sep 07 21:27:59.224249 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:27:59.224213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:28:05.221142 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:05.221097    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 21:28:05.221561 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:05.221187    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 21:28:07.278184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.278147    2583 generic.go:356] "Generic (PLEG): container finished" podID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerID="37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f" exitCode=0
Sep 07 21:28:07.278599 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.278204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerDied","Data":"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"}
Sep 07 21:28:07.278656 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.278637    2583 scope.go:117] "RemoveContainer" containerID="37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"
Sep 07 21:28:07.279895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.279859    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:07.279984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.279935    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:07.280082 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:07.279987    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:08.285204 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:08.285166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerStarted","Data":"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"}
Sep 07 21:28:09.101352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:09.101312    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:28:09.101554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:09.101484    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 07 21:28:09.101554 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:09.101529    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 07 21:28:10.100154 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:10.100115    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 07 21:28:10.100782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:10.100741    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 07 21:28:11.099615 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:11.099566    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 07 21:28:11.099846 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:11.099658    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 07 21:28:12.099828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:12.099781    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 07 21:28:12.100491 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:12.100456    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 07 21:28:13.100174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:13.100125    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 07 21:28:13.100559 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:13.100201    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 07 21:28:14.103317 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:14.103285    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:28:14.103694 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:14.103628    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:28:14.104362 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:14.104331    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:28:15.038015 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.037972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:15.698908 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.698873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:15.975541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.975455    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:28:15.978468 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.978444    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:15.980906 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.980884    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-629e95-openshift-default-dockercfg-pjvsn\""
Sep 07 21:28:15.991808 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:15.991776    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:28:16.000652 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.000617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:16.099413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57pdt\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.099823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.099818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201423 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.201677 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202050 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202050 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.201727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57pdt\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202282 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.202243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202755 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.202644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202755 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.202703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.202867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.202978 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.202888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.205072 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.205050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.205247 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.205226    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.210285 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.210254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57pdt\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.210520 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.210505    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token\") pod \"e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") " pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.249266 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.249181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:16.291015 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.290981    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:16.567168 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.567142    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:28:16.568899 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:28:16.568872    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2ae633_ab1e_4b3c_9fa1_2e8e9cdc97b2.slice/crio-98a75f9193d4c38a7b81e16faa3c85ada92f40a4929d15c2ed1331d24b200c61 WatchSource:0}: Error finding container 98a75f9193d4c38a7b81e16faa3c85ada92f40a4929d15c2ed1331d24b200c61: Status 404 returned error can't find the container with id 98a75f9193d4c38a7b81e16faa3c85ada92f40a4929d15c2ed1331d24b200c61
Sep 07 21:28:16.571180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.571140    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:16.571251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.571232    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:16.571289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:16.571276    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:17.339743 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:17.339700    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerStarted","Data":"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"}
Sep 07 21:28:17.340245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:17.339751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerStarted","Data":"98a75f9193d4c38a7b81e16faa3c85ada92f40a4929d15c2ed1331d24b200c61"}
Sep 07 21:28:17.359868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:17.359817    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podStartSLOduration=2.359799769 podStartE2EDuration="2.359799769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:28:17.357090288 +0000 UTC m=+1609.193216394" watchObservedRunningTime="2026-09-07 21:28:17.359799769 +0000 UTC m=+1609.195925875"
Sep 07 21:28:18.291647 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:18.291607    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:18.296956 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:18.296915    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:18.345207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:18.345168    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:18.346129 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:18.346111    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:19.247356 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:19.247318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:19.337499 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:19.337466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:20.418122 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:20.418071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:20.519455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:20.519415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:20.878994 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:20.878888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:20.979567 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:20.979532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:21.060844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:21.060807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:40.470254 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.470218    2583 generic.go:356] "Generic (PLEG): container finished" podID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerID="3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775" exitCode=0
Sep 07 21:28:40.470652 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.470289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerDied","Data":"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"}
Sep 07 21:28:40.470700 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.470661    2583 scope.go:117] "RemoveContainer" containerID="3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"
Sep 07 21:28:40.471724 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.471695    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:40.471777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.471768    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:40.471814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:40.471799    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:28:41.477366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:41.477332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerStarted","Data":"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"}
Sep 07 21:28:42.291782 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:42.291748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:42.292057 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:42.292034    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 07 21:28:42.292119 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:42.292080    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 07 21:28:43.291587 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:43.291549    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 07 21:28:43.291979 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:43.291615    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 07 21:28:44.224445 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:44.224406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:28:44.291958 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:44.291905    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 07 21:28:44.292323 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:44.291983    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 07 21:28:45.291824 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:45.291792    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 07 21:28:45.292017 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:45.291844    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 07 21:28:46.292332 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:46.292296    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 07 21:28:46.292723 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:46.292351    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 07 21:28:47.295814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:47.295774    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:47.296289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:47.296152    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:47.296864 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:47.296844    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:28:49.245037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:49.245013    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:28:53.280311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:28:53.280277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:11.690238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:11.690201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:19.908632 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:19.908600    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:29:20.294683 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.294600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:20.580906 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.580823    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:29:20.584685 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.584664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.586975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.586911    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-f420a1-openshift-default-dockercfg-bgfcr\""
Sep 07 21:29:20.597538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.597511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:29:20.610309 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.610275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:20.634786 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.634757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.634902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.634792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.634902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.634847    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.634902 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.634897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.635052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.634919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.635052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.635002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.635052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.635032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.635155 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.635110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.635193 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.635154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbnw\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbnw\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.737591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.738098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.738857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.738480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.741223 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.741182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.741503 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.741481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.742967 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.742241    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.742967 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.742505    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.742967 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.742509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.747114 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.747092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.752101 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.752080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbnw\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw\") pod \"e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") " pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:20.896536 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:20.896455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:21.017853 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.017797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:21.176351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.176324    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:29:21.178599 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:29:21.178566    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93449e3a_06f9_46bb_89aa_d41cc27e4f0f.slice/crio-4f72bc1bbc5741724b9e9530bd012aa7aed6ecf0545696501c7fda013ee8afbc WatchSource:0}: Error finding container 4f72bc1bbc5741724b9e9530bd012aa7aed6ecf0545696501c7fda013ee8afbc: Status 404 returned error can't find the container with id 4f72bc1bbc5741724b9e9530bd012aa7aed6ecf0545696501c7fda013ee8afbc
Sep 07 21:29:21.180988 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.180908    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:21.181064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.181005    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:21.181064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.181042    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:21.698969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.698921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerStarted","Data":"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"}
Sep 07 21:29:21.699180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.698997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerStarted","Data":"4f72bc1bbc5741724b9e9530bd012aa7aed6ecf0545696501c7fda013ee8afbc"}
Sep 07 21:29:21.720778 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.720724    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podStartSLOduration=1.720706514 podStartE2EDuration="1.720706514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:29:21.719527843 +0000 UTC m=+1673.555653949" watchObservedRunningTime="2026-09-07 21:29:21.720706514 +0000 UTC m=+1673.556832619"
Sep 07 21:29:21.897410 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:21.897367    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:22.904478 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:22.904440    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:23.612817 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:23.612783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:23.703336 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:23.703302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:23.709364 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:23.709339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:23.710189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:23.710171    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:24.832568 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:24.832535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:24.932752 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:24.932717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:25.296345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:25.296312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:25.398778 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:25.398735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:25.475840 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:25.475811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:42.808727 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.808654    2583 generic.go:356] "Generic (PLEG): container finished" podID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerID="96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c" exitCode=0
Sep 07 21:29:42.809185 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.808722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerDied","Data":"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"}
Sep 07 21:29:42.809185 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.809117    2583 scope.go:117] "RemoveContainer" containerID="96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"
Sep 07 21:29:42.810211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.810183    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:42.810334 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.810261    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:42.810334 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:42.810311    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 07 21:29:43.401217 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.401183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:43.456222 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.456182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:43.819903 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.819866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerStarted","Data":"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"}
Sep 07 21:29:43.897121 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.897087    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:43.897490 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.897464    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:43.897577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:43.897548    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:44.897418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:44.896984    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:44.897418 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:44.897060    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:45.897585 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:45.897549    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:45.898169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:45.898131    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:46.897556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:46.897510    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:46.897760 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:46.897582    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:47.897606 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:47.897569    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:47.897885 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:47.897856    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:48.580996 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:48.580957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:48.898094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:48.898002    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 07 21:29:48.898094 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:48.898076    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 07 21:29:49.901856 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:49.901823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:49.902259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:49.902240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:49.903011 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:49.902991    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:29:55.435339 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:55.435300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:55.535521 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:55.535485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:55.618814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:55.618782    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:55.677014 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:55.676981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:55.934829 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:55.934790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:29:56.036366 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:29:56.036328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:00.137522 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.137487    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"]
Sep 07 21:30:00.141687 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.141663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"
Sep 07 21:30:00.143970 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.143934    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:30:00.153081 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.153059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"]
Sep 07 21:30:00.155375 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.155353    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"
Sep 07 21:30:00.427510 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.427473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"]
Sep 07 21:30:00.429135 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:30:00.429105    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8322a510_531a_4a06_bda5_470b54c0afb1.slice/crio-35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476 WatchSource:0}: Error finding container 35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476: Status 404 returned error can't find the container with id 35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476
Sep 07 21:30:00.928834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.928796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6" event={"ID":"8322a510-531a-4a06-bda5-470b54c0afb1","Type":"ContainerStarted","Data":"46726ccba6ba02220072f12d293afc299621cefc8adceb34545eccc6e351abd0"}
Sep 07 21:30:00.929026 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.928853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6" event={"ID":"8322a510-531a-4a06-bda5-470b54c0afb1","Type":"ContainerStarted","Data":"35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476"}
Sep 07 21:30:00.944283 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:00.944228    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6" podStartSLOduration=0.944212491 podStartE2EDuration="944.212491ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:30:00.941628504 +0000 UTC m=+1712.777754605" watchObservedRunningTime="2026-09-07 21:30:00.944212491 +0000 UTC m=+1712.780338596"
Sep 07 21:30:01.926016 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:01.925979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:01.936644 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:01.936611    2583 generic.go:356] "Generic (PLEG): container finished" podID="8322a510-531a-4a06-bda5-470b54c0afb1" containerID="46726ccba6ba02220072f12d293afc299621cefc8adceb34545eccc6e351abd0" exitCode=0
Sep 07 21:30:01.936814 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:01.936685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6" event={"ID":"8322a510-531a-4a06-bda5-470b54c0afb1","Type":"ContainerDied","Data":"46726ccba6ba02220072f12d293afc299621cefc8adceb34545eccc6e351abd0"}
Sep 07 21:30:02.026389 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:02.026354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:02.144541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:02.144501    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:30:02.144802 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:02.144775    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" containerID="cri-o://c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05" gracePeriod=30
Sep 07 21:30:02.194534 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:02.194444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:03.079474 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:03.079436    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"
Sep 07 21:30:03.948579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:03.948544    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"
Sep 07 21:30:03.948579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:03.948571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6" event={"ID":"8322a510-531a-4a06-bda5-470b54c0afb1","Type":"ContainerDied","Data":"35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476"}
Sep 07 21:30:03.948799 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:03.948628    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35cc4b86017d32ad1fcafe7dbd9fad7a047930a1f0f78af5d22fb07de0922476"
Sep 07 21:30:04.905211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:04.905176    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:30:04.905666 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:04.905241    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:30:05.811489 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:05.811447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:07.400323 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.400292    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:30:07.531757 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531716    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.531990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531792    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.531990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531841    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhbnw\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.531990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531890    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.531990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.531990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.531984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.532267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532019    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.532267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532072    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.532267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token\") pod \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\" (UID: \"93449e3a-06f9-46bb-89aa-d41cc27e4f0f\") "
Sep 07 21:30:07.532267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:30:07.532267 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532245    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:30:07.532514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532277    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:30:07.532514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532365    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:30:07.532514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532398    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:30:07.532668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532537    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.532668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532557    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.532668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532573    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.532668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532581    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.532668 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.532589    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.534190 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.534153    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw" (OuterVolumeSpecName: "kube-api-access-rhbnw") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "kube-api-access-rhbnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:30:07.534310 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.534190    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:30:07.534386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.534369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:30:07.534519 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.534499    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93449e3a-06f9-46bb-89aa-d41cc27e4f0f" (UID: "93449e3a-06f9-46bb-89aa-d41cc27e4f0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:30:07.633960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.633915    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.633960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.633963    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.634176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.633979    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.634176 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.633990    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhbnw\" (UniqueName: \"kubernetes.io/projected/93449e3a-06f9-46bb-89aa-d41cc27e4f0f-kube-api-access-rhbnw\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:07.971225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.971192    2583 generic.go:356] "Generic (PLEG): container finished" podID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerID="c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05" exitCode=0
Sep 07 21:30:07.971409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.971237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerDied","Data":"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"}
Sep 07 21:30:07.971409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.971241    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"
Sep 07 21:30:07.971409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.971279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n" event={"ID":"93449e3a-06f9-46bb-89aa-d41cc27e4f0f","Type":"ContainerDied","Data":"4f72bc1bbc5741724b9e9530bd012aa7aed6ecf0545696501c7fda013ee8afbc"}
Sep 07 21:30:07.971409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.971301    2583 scope.go:117] "RemoveContainer" containerID="c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"
Sep 07 21:30:07.981163 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.981145    2583 scope.go:117] "RemoveContainer" containerID="96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"
Sep 07 21:30:07.991237 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.991216    2583 scope.go:117] "RemoveContainer" containerID="c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"
Sep 07 21:30:07.991523 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:30:07.991503    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05\": container with ID starting with c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05 not found: ID does not exist" containerID="c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"
Sep 07 21:30:07.991592 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.991531    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05"} err="failed to get container status \"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05\": rpc error: code = NotFound desc = could not find container \"c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05\": container with ID starting with c195fb33162162f931d2d8d3d0efd710796762f32308fb88c02f0a9a7e000a05 not found: ID does not exist"
Sep 07 21:30:07.991592 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.991549    2583 scope.go:117] "RemoveContainer" containerID="96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"
Sep 07 21:30:07.991807 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:30:07.991784    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c\": container with ID starting with 96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c not found: ID does not exist" containerID="96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"
Sep 07 21:30:07.991851 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.991817    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c"} err="failed to get container status \"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c\": rpc error: code = NotFound desc = could not find container \"96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c\": container with ID starting with 96ca4d807fac203519209ce76ff7f23611567eb4f0c8211d201992dbf84d3d4c not found: ID does not exist"
Sep 07 21:30:07.994972 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:07.994935    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:30:08.000599 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:08.000575    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n"]
Sep 07 21:30:08.677743 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:08.677710    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" path="/var/lib/kubelet/pods/93449e3a-06f9-46bb-89aa-d41cc27e4f0f/volumes"
Sep 07 21:30:21.123610 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.123574    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:30:21.124327 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.123793    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" podUID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" containerName="maas-api" containerID="cri-o://2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3" gracePeriod=30
Sep 07 21:30:21.154968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.154902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:21.254399 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.254360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:21.355355 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.355314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:21.388969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.388885    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:30:21.417248 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.417186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:21.466032 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.465999    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls\") pod \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") "
Sep 07 21:30:21.466235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.466099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca\") pod \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") "
Sep 07 21:30:21.466235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.466174    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs\") pod \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") "
Sep 07 21:30:21.466235 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.466216    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b779j\" (UniqueName: \"kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j\") pod \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\" (UID: \"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef\") "
Sep 07 21:30:21.466805 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.466779    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" (UID: "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:30:21.468879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.468849    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" (UID: "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:30:21.469238 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.469176    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j" (OuterVolumeSpecName: "kube-api-access-b779j") pod "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" (UID: "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef"). InnerVolumeSpecName "kube-api-access-b779j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:30:21.469357 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.469295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" (UID: "0b21c9d8-f75c-4bc3-ae74-e99495aa0cef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:30:21.567728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.567692    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.567728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.567722    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b779j\" (UniqueName: \"kubernetes.io/projected/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-kube-api-access-b779j\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.567728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.567733    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.567989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.567741    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:30:21.705206 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:21.705171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:22.051660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.051558    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" containerID="2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3" exitCode=0
Sep 07 21:30:22.051660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.051612    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"
Sep 07 21:30:22.051660 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.051632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" event={"ID":"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef","Type":"ContainerDied","Data":"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"}
Sep 07 21:30:22.051969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.051674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn" event={"ID":"0b21c9d8-f75c-4bc3-ae74-e99495aa0cef","Type":"ContainerDied","Data":"dbb5283935e99b08b114b4cc8efb490e7195cb90ecd7f6fd6e4c916cd02faea4"}
Sep 07 21:30:22.051969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.051696    2583 scope.go:117] "RemoveContainer" containerID="2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"
Sep 07 21:30:22.061773 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.061746    2583 scope.go:117] "RemoveContainer" containerID="2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"
Sep 07 21:30:22.062148 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:30:22.062120    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3\": container with ID starting with 2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3 not found: ID does not exist" containerID="2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"
Sep 07 21:30:22.062245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.062163    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3"} err="failed to get container status \"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3\": rpc error: code = NotFound desc = could not find container \"2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3\": container with ID starting with 2bbcca7c5bfbeb200a7c023832056b4f8a5e24989cd2f53f579d0829ae974ff3 not found: ID does not exist"
Sep 07 21:30:22.075215 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.075187    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:30:22.078579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.078552    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-52269e-d75788b-dzrqn"]
Sep 07 21:30:22.677413 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:22.677379    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" path="/var/lib/kubelet/pods/0b21c9d8-f75c-4bc3-ae74-e99495aa0cef/volumes"
Sep 07 21:30:26.789712 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:26.789678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:30:53.616966 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:30:53.616909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:03.231377 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:03.231335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:03.604345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:03.604258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:09.306602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:09.306566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:09.407257 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:09.407209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:09.575758 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:09.575669    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:31:09.575928 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:09.575890    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" containerID="cri-o://135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc" gracePeriod=30
Sep 07 21:31:09.600315 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:09.600277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:10.021141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:10.021100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:10.869576 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:10.869532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:14.107038 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.107001    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:31:14.107405 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.107061    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:31:14.818471 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.818442    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:31:14.985111 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985075    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985111 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm4b6\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985155    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985182    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985300    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985386 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985327    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985437    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo\") pod \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\" (UID: \"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a\") "
Sep 07 21:31:14.985692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985415    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:14.985692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985481    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:14.985692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985488    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:14.985692 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985672    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:14.985975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985810    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:14.985975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985839    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:14.985975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985853    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:14.985975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985865    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:14.985975 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.985804    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:14.987464 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.987434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:14.987570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.987472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6" (OuterVolumeSpecName: "kube-api-access-qm4b6") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "kube-api-access-qm4b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:14.987570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.987486    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:31:14.987570 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:14.987503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" (UID: "3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:15.086696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.086666    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:15.086696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.086692    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm4b6\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-kube-api-access-qm4b6\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:15.086696 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.086702    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:15.086925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.086710    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:15.086925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.086720    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:15.333834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.333740    2583 generic.go:356] "Generic (PLEG): container finished" podID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerID="135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc" exitCode=0
Sep 07 21:31:15.333834 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.333787    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"
Sep 07 21:31:15.334345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.333825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerDied","Data":"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"}
Sep 07 21:31:15.334345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.333894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw" event={"ID":"3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a","Type":"ContainerDied","Data":"c3a86934eb68c7d0b8e1f92a4e62b9488c2c79b934864caf50f5aa52ab817477"}
Sep 07 21:31:15.334345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.333929    2583 scope.go:117] "RemoveContainer" containerID="135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"
Sep 07 21:31:15.343391 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.343371    2583 scope.go:117] "RemoveContainer" containerID="37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"
Sep 07 21:31:15.351030 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.351016    2583 scope.go:117] "RemoveContainer" containerID="135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"
Sep 07 21:31:15.351266 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:31:15.351249    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc\": container with ID starting with 135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc not found: ID does not exist" containerID="135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"
Sep 07 21:31:15.351304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.351278    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc"} err="failed to get container status \"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc\": rpc error: code = NotFound desc = could not find container \"135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc\": container with ID starting with 135b882821a3b6d38de20cd94a071bc2dc2e54cc0b0e7de322ed840dfa5c99bc not found: ID does not exist"
Sep 07 21:31:15.351304 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.351294    2583 scope.go:117] "RemoveContainer" containerID="37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"
Sep 07 21:31:15.351600 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:31:15.351568    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f\": container with ID starting with 37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f not found: ID does not exist" containerID="37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"
Sep 07 21:31:15.351681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.351610    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f"} err="failed to get container status \"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f\": rpc error: code = NotFound desc = could not find container \"37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f\": container with ID starting with 37d55bd1a47bdf86c15b1e4d7660a130c0951fdd49e624cbea69810bd168976f not found: ID does not exist"
Sep 07 21:31:15.354100 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.354079    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:31:15.360167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:15.360147    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw"]
Sep 07 21:31:16.677032 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:16.676996    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" path="/var/lib/kubelet/pods/3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a/volumes"
Sep 07 21:31:20.384822 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.384791    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"]
Sep 07 21:31:20.385314 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.385274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:20.387342 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.387321    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-629e95-29813610-d9nb6"]
Sep 07 21:31:20.452166 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.452134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:20.522832 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.522796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:20.581681 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.581631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:20.677189 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.677154    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8322a510-531a-4a06-bda5-470b54c0afb1" path="/var/lib/kubelet/pods/8322a510-531a-4a06-bda5-470b54c0afb1/volumes"
Sep 07 21:31:20.935239 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:20.935147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:22.002921 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:22.002884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:26.775597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:26.775560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:26.875858 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:26.875821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:27.022657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:27.022622    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:31:27.023188 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:27.022897    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy" containerID="cri-o://ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73" gracePeriod=30
Sep 07 21:31:27.046830 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:27.046739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:27.499774 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:27.499733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:28.815567 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:28.815540    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:31:28.819024 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:28.819004    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:31:32.275325 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.275301    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:31:32.344730 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344662    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57pdt\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.344730 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344705    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.344969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344752    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.344969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.344969 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344881    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.345141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.344935    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.345141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.345141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345053    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.345141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy\") pod \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\" (UID: \"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2\") "
Sep 07 21:31:32.345141 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345100    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:32.345380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:32.345380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345218    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:32.345380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345309    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:32.345380 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345333    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:32.345597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345510    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.345597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345527    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.345597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345540    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.345597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345552    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.345597 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.345565    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.346984 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.346957    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt" (OuterVolumeSpecName: "kube-api-access-57pdt") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "kube-api-access-57pdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:32.347105 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.347068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:31:32.347167 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.347143    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:32.347216 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.347198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" (UID: "0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:31:32.429665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.429628    2583 generic.go:356] "Generic (PLEG): container finished" podID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerID="ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73" exitCode=0
Sep 07 21:31:32.429843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.429679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerDied","Data":"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"}
Sep 07 21:31:32.429843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.429721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf" event={"ID":"0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2","Type":"ContainerDied","Data":"98a75f9193d4c38a7b81e16faa3c85ada92f40a4929d15c2ed1331d24b200c61"}
Sep 07 21:31:32.429843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.429683    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"
Sep 07 21:31:32.429843 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.429747    2583 scope.go:117] "RemoveContainer" containerID="ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"
Sep 07 21:31:32.438674 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.438657    2583 scope.go:117] "RemoveContainer" containerID="3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"
Sep 07 21:31:32.446352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446333    2583 scope.go:117] "RemoveContainer" containerID="ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"
Sep 07 21:31:32.446625 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:31:32.446607    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73\": container with ID starting with ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73 not found: ID does not exist" containerID="ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"
Sep 07 21:31:32.446704 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446637    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73"} err="failed to get container status \"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73\": rpc error: code = NotFound desc = could not find container \"ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73\": container with ID starting with ad8ce0bc335eafcfb11d9453875182d1b15bebd1386c11b9e7a7fb976c19ed73 not found: ID does not exist"
Sep 07 21:31:32.446704 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446663    2583 scope.go:117] "RemoveContainer" containerID="3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"
Sep 07 21:31:32.446789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446705    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.446789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446724    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.446789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446732    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57pdt\" (UniqueName: \"kubernetes.io/projected/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-kube-api-access-57pdt\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.446789 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446741    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:32.446911 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:31:32.446893    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775\": container with ID starting with 3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775 not found: ID does not exist" containerID="3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"
Sep 07 21:31:32.446971 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.446915    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775"} err="failed to get container status \"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775\": rpc error: code = NotFound desc = could not find container \"3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775\": container with ID starting with 3c0bf18302727f5e1ba6e55bfab38cba0f0120841fa23a5e88770a7c1558a775 not found: ID does not exist"
Sep 07 21:31:32.451124 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.451099    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:31:32.455864 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.455844    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf"]
Sep 07 21:31:32.676516 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:32.676484    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" path="/var/lib/kubelet/pods/0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2/volumes"
Sep 07 21:31:37.924402 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:37.924372    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:31:37.924972 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:37.924638    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" podUID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" containerName="maas-api" containerID="cri-o://8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029" gracePeriod=30
Sep 07 21:31:37.949904 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:37.949877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:38.048707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.048675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:38.130972 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.130925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:38.172857 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.172833    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:31:38.187356 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.187298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:38.198904 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.198881    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca\") pod \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") "
Sep 07 21:31:38.199131 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.198977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs\") pod \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") "
Sep 07 21:31:38.199131 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.199023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls\") pod \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") "
Sep 07 21:31:38.199131 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.199054    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-726fs\" (UniqueName: \"kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs\") pod \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\" (UID: \"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca\") "
Sep 07 21:31:38.199830 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.199793    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" (UID: "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:38.201980 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.201919    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" (UID: "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:38.202080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.201920    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs" (OuterVolumeSpecName: "kube-api-access-726fs") pod "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" (UID: "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca"). InnerVolumeSpecName "kube-api-access-726fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:31:38.202148 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.202129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" (UID: "b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:31:38.300533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.300495    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.300533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.300535    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.300716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.300551    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-726fs\" (UniqueName: \"kubernetes.io/projected/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-kube-api-access-726fs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.300716 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.300565    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:38.461569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.461490    2583 generic.go:356] "Generic (PLEG): container finished" podID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" containerID="8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029" exitCode=0
Sep 07 21:31:38.461569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.461537    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"
Sep 07 21:31:38.461569 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.461543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" event={"ID":"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca","Type":"ContainerDied","Data":"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"}
Sep 07 21:31:38.461785 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.461595    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq" event={"ID":"b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca","Type":"ContainerDied","Data":"c6d078fd3ac056164a9f22977bd95d19bc5ea74c6a362cfdab8043e76dc31101"}
Sep 07 21:31:38.461785 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.461625    2583 scope.go:117] "RemoveContainer" containerID="8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"
Sep 07 21:31:38.470923 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.470899    2583 scope.go:117] "RemoveContainer" containerID="8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"
Sep 07 21:31:38.471184 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:31:38.471165    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029\": container with ID starting with 8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029 not found: ID does not exist" containerID="8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"
Sep 07 21:31:38.471236 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.471193    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029"} err="failed to get container status \"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029\": rpc error: code = NotFound desc = could not find container \"8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029\": container with ID starting with 8e13f244bf89c087ac6b576594e4f57ed37eac17b3632e2740069eda05fa5029 not found: ID does not exist"
Sep 07 21:31:38.482232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.482212    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:31:38.487395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.487372    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-15d5e2-78b86bb7bb-lqrpq"]
Sep 07 21:31:38.502216 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.502168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:38.676451 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:38.676406    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" path="/var/lib/kubelet/pods/b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca/volumes"
Sep 07 21:31:44.879775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:44.879706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:44.937728 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:44.937686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:45.126032 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.125992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:45.467127 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467095    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"]
Sep 07 21:31:45.467481 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467468    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467496    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" containerName="maas-api"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467501    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" containerName="maas-api"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467507    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467513    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467521    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467533 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467526    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467536    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467541    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467553    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8322a510-531a-4a06-bda5-470b54c0afb1" containerName="cleanup"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467558    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8322a510-531a-4a06-bda5-470b54c0afb1" containerName="cleanup"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467566    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" containerName="maas-api"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467572    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" containerName="maas-api"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467578    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467582    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467631    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467645    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467652    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="93449e3a-06f9-46bb-89aa-d41cc27e4f0f" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467657    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a18d56-54e8-4f5d-ab28-6a4ed54c23ca" containerName="maas-api"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467662    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b21c9d8-f75c-4bc3-ae74-e99495aa0cef" containerName="maas-api"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467667    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8322a510-531a-4a06-bda5-470b54c0afb1" containerName="cleanup"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467673    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.467739 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.467678    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3973ebfe-09ed-4d6f-a8e1-3a1c7aa8474a" containerName="istio-proxy"
Sep 07 21:31:45.472046 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.472028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:45.474374 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.474352    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:31:45.475273 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.475249    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mv4w\""
Sep 07 21:31:45.476682 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.476659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"]
Sep 07 21:31:45.560600 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.560572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:45.565747 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.565728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29\" (UID: \"05063366-a935-4a10-be65-9075e75986ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:45.667203 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.667165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29\" (UID: \"05063366-a935-4a10-be65-9075e75986ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:45.667742 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.667722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29\" (UID: \"05063366-a935-4a10-be65-9075e75986ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:45.784579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:45.784488    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:46.052667 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:46.052641    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"]
Sep 07 21:31:46.054571 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:31:46.054543    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05063366_a935_4a10_be65_9075e75986ba.slice/crio-42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958 WatchSource:0}: Error finding container 42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958: Status 404 returned error can't find the container with id 42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958
Sep 07 21:31:46.504417 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:46.504384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29" event={"ID":"05063366-a935-4a10-be65-9075e75986ba","Type":"ContainerStarted","Data":"9083a08c5766ca558520fc95967e3d61d389356aa07a7399c23a02193d27ba6f"}
Sep 07 21:31:46.504602 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:46.504437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29" event={"ID":"05063366-a935-4a10-be65-9075e75986ba","Type":"ContainerStarted","Data":"42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958"}
Sep 07 21:31:46.520553 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:46.520507    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29" podStartSLOduration=1.520493713 podStartE2EDuration="1.520493713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:31:46.519143542 +0000 UTC m=+1818.355269647" watchObservedRunningTime="2026-09-07 21:31:46.520493713 +0000 UTC m=+1818.356619817"
Sep 07 21:31:47.512043 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:47.512002    2583 generic.go:356] "Generic (PLEG): container finished" podID="05063366-a935-4a10-be65-9075e75986ba" containerID="9083a08c5766ca558520fc95967e3d61d389356aa07a7399c23a02193d27ba6f" exitCode=0
Sep 07 21:31:47.512505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:47.512062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29" event={"ID":"05063366-a935-4a10-be65-9075e75986ba","Type":"ContainerDied","Data":"9083a08c5766ca558520fc95967e3d61d389356aa07a7399c23a02193d27ba6f"}
Sep 07 21:31:48.645480 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:48.645456    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:48.696455 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:48.696424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca\") pod \"05063366-a935-4a10-be65-9075e75986ba\" (UID: \"05063366-a935-4a10-be65-9075e75986ba\") "
Sep 07 21:31:48.696797 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:48.696776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05063366-a935-4a10-be65-9075e75986ba" (UID: "05063366-a935-4a10-be65-9075e75986ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:31:48.798301 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:48.798217    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05063366-a935-4a10-be65-9075e75986ba-maas-api-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:31:49.522713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:49.522687    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"
Sep 07 21:31:49.522880 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:49.522684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29" event={"ID":"05063366-a935-4a10-be65-9075e75986ba","Type":"ContainerDied","Data":"42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958"}
Sep 07 21:31:49.522880 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:49.522807    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42f9930bfd93ca51b142dcf6bd26124fd2579b8f2cfe3262122af4114af7f958"
Sep 07 21:31:55.950286 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:55.950248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:56.049064 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.049027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:56.135744 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.135711    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"]
Sep 07 21:31:56.138706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.138677    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-7fa21f-68s29"]
Sep 07 21:31:56.138706 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.138692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:56.207440 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.207337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:56.516008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.515909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:31:56.676763 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:31:56.676731    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05063366-a935-4a10-be65-9075e75986ba" path="/var/lib/kubelet/pods/05063366-a935-4a10-be65-9075e75986ba/volumes"
Sep 07 21:32:02.430715 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:02.430676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:32:02.492707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:02.492677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:32:02.677918 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:02.677884    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:32:02.678184 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:02.678139    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" containerID="cri-o://f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713" gracePeriod=30
Sep 07 21:32:02.688556 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:02.688492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:32:07.062207 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:07.062166    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 21:32:07.062589 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:07.062236    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 21:32:07.926526 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:07.926501    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:32:08.073767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073667    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.073767 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073754    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073827    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073850    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.073973    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074012    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgfqc\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token\") pod \"7a7deca7-346e-493e-adba-411dadda3a08\" (UID: \"7a7deca7-346e-493e-adba-411dadda3a08\") "
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074073    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:32:08.074298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074233    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074324    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074408    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a7deca7-346e-493e-adba-411dadda3a08-istiod-ca-cert\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074424    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074433    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-credential-socket\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074443    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-data\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.074756 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.074451    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-workload-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.076008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.075979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:32:08.076126 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.076084    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc" (OuterVolumeSpecName: "kube-api-access-kgfqc") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "kube-api-access-kgfqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:32:08.076404 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.076380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:32:08.076512 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.076377    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a7deca7-346e-493e-adba-411dadda3a08" (UID: "7a7deca7-346e-493e-adba-411dadda3a08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 21:32:08.175080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.175037    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a7deca7-346e-493e-adba-411dadda3a08-istio-podinfo\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.175080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.175071    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a7deca7-346e-493e-adba-411dadda3a08-istio-envoy\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.175080 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.175081    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgfqc\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-kube-api-access-kgfqc\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.175311 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.175090    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7deca7-346e-493e-adba-411dadda3a08-istio-token\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:32:08.623077 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.623043    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a7deca7-346e-493e-adba-411dadda3a08" containerID="f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713" exitCode=0
Sep 07 21:32:08.623259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.623090    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"
Sep 07 21:32:08.623259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.623116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerDied","Data":"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"}
Sep 07 21:32:08.623259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.623161    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h" event={"ID":"7a7deca7-346e-493e-adba-411dadda3a08","Type":"ContainerDied","Data":"1820db58d8738134b8d966ae0d81b05611d336e7921b7334817116cea49fce60"}
Sep 07 21:32:08.623259 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.623185    2583 scope.go:117] "RemoveContainer" containerID="f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"
Sep 07 21:32:08.632779 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.632762    2583 scope.go:117] "RemoveContainer" containerID="f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"
Sep 07 21:32:08.640593 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.640575    2583 scope.go:117] "RemoveContainer" containerID="f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"
Sep 07 21:32:08.640842 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:32:08.640825    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713\": container with ID starting with f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713 not found: ID does not exist" containerID="f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"
Sep 07 21:32:08.640886 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.640850    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713"} err="failed to get container status \"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713\": rpc error: code = NotFound desc = could not find container \"f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713\": container with ID starting with f726c795291ca913501ebb69036abd2796ee69846c12648b6c9c024c904ef713 not found: ID does not exist"
Sep 07 21:32:08.640886 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.640866    2583 scope.go:117] "RemoveContainer" containerID="f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"
Sep 07 21:32:08.641180 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:32:08.641134    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5\": container with ID starting with f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5 not found: ID does not exist" containerID="f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"
Sep 07 21:32:08.641180 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.641153    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5"} err="failed to get container status \"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5\": rpc error: code = NotFound desc = could not find container \"f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5\": container with ID starting with f7fcd15ed630121b413c15adf57bf3eecda11c4acf03b4422d9c9f3cd686eff5 not found: ID does not exist"
Sep 07 21:32:08.643992 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.643969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:32:08.647212 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.647191    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h"]
Sep 07 21:32:08.676473 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:08.676446    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a7deca7-346e-493e-adba-411dadda3a08" path="/var/lib/kubelet/pods/7a7deca7-346e-493e-adba-411dadda3a08/volumes"
Sep 07 21:32:59.756153 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:32:59.756107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:33:27.905704 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:33:27.905665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:33:30.138485 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:33:30.138431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:33:31.619378 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:33:31.619345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:34:54.076211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.076173    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:34:54.078823 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.076414    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerName="manager" containerID="cri-o://a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1" gracePeriod=10
Sep 07 21:34:54.176151 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.176104    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.34:8081/readyz\": dial tcp 10.132.0.34:8081: connect: connection refused"
Sep 07 21:34:54.334649 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.334587    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:34:54.446433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.445922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume\") pod \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") "
Sep 07 21:34:54.446433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.446025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flst7\" (UniqueName: \"kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7\") pod \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\" (UID: \"71579ce8-aedd-4a9c-9c78-6fa7aa53b311\") "
Sep 07 21:34:54.446433 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.446371    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "71579ce8-aedd-4a9c-9c78-6fa7aa53b311" (UID: "71579ce8-aedd-4a9c-9c78-6fa7aa53b311"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:34:54.448149 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.448121    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7" (OuterVolumeSpecName: "kube-api-access-flst7") pod "71579ce8-aedd-4a9c-9c78-6fa7aa53b311" (UID: "71579ce8-aedd-4a9c-9c78-6fa7aa53b311"). InnerVolumeSpecName "kube-api-access-flst7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:34:54.467960 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.467907    2583 generic.go:356] "Generic (PLEG): container finished" podID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerID="a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1" exitCode=0
Sep 07 21:34:54.468089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.467969    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"
Sep 07 21:34:54.468089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.467992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" event={"ID":"71579ce8-aedd-4a9c-9c78-6fa7aa53b311","Type":"ContainerDied","Data":"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"}
Sep 07 21:34:54.468089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.468044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55" event={"ID":"71579ce8-aedd-4a9c-9c78-6fa7aa53b311","Type":"ContainerDied","Data":"38939e973818f27e152fa8a6f35ef91521b280097bb79d83d3e025332fbf0701"}
Sep 07 21:34:54.468089 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.468067    2583 scope.go:117] "RemoveContainer" containerID="a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"
Sep 07 21:34:54.477713 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.477692    2583 scope.go:117] "RemoveContainer" containerID="a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"
Sep 07 21:34:54.478010 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:34:54.477988    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1\": container with ID starting with a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1 not found: ID does not exist" containerID="a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"
Sep 07 21:34:54.478076 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.478021    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1"} err="failed to get container status \"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1\": rpc error: code = NotFound desc = could not find container \"a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1\": container with ID starting with a36b98846dda2617d9c2523c9a12336b57af510808282234031ca3fe88e232f1 not found: ID does not exist"
Sep 07 21:34:54.497577 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.497553    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:34:54.502665 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.502637    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qdl55"]
Sep 07 21:34:54.547057 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.547026    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-extensions-socket-volume\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:34:54.547057 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.547055    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flst7\" (UniqueName: \"kubernetes.io/projected/71579ce8-aedd-4a9c-9c78-6fa7aa53b311-kube-api-access-flst7\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:34:54.677008 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:34:54.676977    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" path="/var/lib/kubelet/pods/71579ce8-aedd-4a9c-9c78-6fa7aa53b311/volumes"
Sep 07 21:35:07.744628 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:07.744544    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:35:54.764645 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.764610    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"]
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.764999    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765011    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2ae633-ab1e-4b3c-9fa1-2e8e9cdc97b2" containerName="istio-proxy"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765021    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05063366-a935-4a10-be65-9075e75986ba" containerName="revoke-keys"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765027    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="05063366-a935-4a10-be65-9075e75986ba" containerName="revoke-keys"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765041    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerName="manager"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765049    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerName="manager"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765059    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765064    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765070    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:35:54.765118 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765075    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:35:54.765434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765126    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:35:54.765434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765134    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="05063366-a935-4a10-be65-9075e75986ba" containerName="revoke-keys"
Sep 07 21:35:54.765434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.765144    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="71579ce8-aedd-4a9c-9c78-6fa7aa53b311" containerName="manager"
Sep 07 21:35:54.768087 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.768072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:54.770579 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.770556    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rnbnr\""
Sep 07 21:35:54.781925 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.781901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"]
Sep 07 21:35:54.895354 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.895320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccbc9f6-cd00-446a-884f-799962b922d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:54.895538 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.895392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llml2\" (UniqueName: \"kubernetes.io/projected/1ccbc9f6-cd00-446a-884f-799962b922d6-kube-api-access-llml2\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:54.996662 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.996623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccbc9f6-cd00-446a-884f-799962b922d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:54.996862 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.996721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llml2\" (UniqueName: \"kubernetes.io/projected/1ccbc9f6-cd00-446a-884f-799962b922d6-kube-api-access-llml2\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:54.997052 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:54.997029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccbc9f6-cd00-446a-884f-799962b922d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:55.014802 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.014729    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llml2\" (UniqueName: \"kubernetes.io/projected/1ccbc9f6-cd00-446a-884f-799962b922d6-kube-api-access-llml2\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-kx8pd\" (UID: \"1ccbc9f6-cd00-446a-884f-799962b922d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:55.077479 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.077447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:55.369028 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.368951    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"]
Sep 07 21:35:55.373267 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:35:55.373237    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccbc9f6_cd00_446a_884f_799962b922d6.slice/crio-74145eeba9ec2458ccf0f0dfce87e84e5c9f51516c24707aa43a4dcd5ba0e111 WatchSource:0}: Error finding container 74145eeba9ec2458ccf0f0dfce87e84e5c9f51516c24707aa43a4dcd5ba0e111: Status 404 returned error can't find the container with id 74145eeba9ec2458ccf0f0dfce87e84e5c9f51516c24707aa43a4dcd5ba0e111
Sep 07 21:35:55.771503 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.771466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd" event={"ID":"1ccbc9f6-cd00-446a-884f-799962b922d6","Type":"ContainerStarted","Data":"95d844a5fdea900e138876648fd7256669a2f43af23dad9a62c76c6672b377b4"}
Sep 07 21:35:55.771868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.771523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd" event={"ID":"1ccbc9f6-cd00-446a-884f-799962b922d6","Type":"ContainerStarted","Data":"74145eeba9ec2458ccf0f0dfce87e84e5c9f51516c24707aa43a4dcd5ba0e111"}
Sep 07 21:35:55.771868 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.771567    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:35:55.808140 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:35:55.808092    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd" podStartSLOduration=1.808071347 podStartE2EDuration="1.808071347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:35:55.80578428 +0000 UTC m=+2067.641910384" watchObservedRunningTime="2026-09-07 21:35:55.808071347 +0000 UTC m=+2067.644197452"
Sep 07 21:36:06.778200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:06.778166    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-kx8pd"
Sep 07 21:36:17.571409 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:17.571349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:36:17.630054 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:17.630013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:36:28.848053 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:28.848023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:36:28.852352 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:28.852331    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w65b9_18dd2e15-5dd3-4cd3-9d3e-1ae4fe88adb4/ovn-acl-logging/0.log"
Sep 07 21:36:29.014195 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:29.014157    2583 scope.go:117] "RemoveContainer" containerID="46726ccba6ba02220072f12d293afc299621cefc8adceb34545eccc6e351abd0"
Sep 07 21:36:30.087245 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:30.087204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:36:35.443275 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:35.443244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:36:47.992330 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:47.992281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:36:48.948172 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:36:48.948142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:37:07.900209 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.900124    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:07.900609 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.900598    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7deca7-346e-493e-adba-411dadda3a08" containerName="istio-proxy"
Sep 07 21:37:07.903674 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.903655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:07.907895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.907872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nj5g\""
Sep 07 21:37:07.907895 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.907889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 21:37:07.908082 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.907876    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 21:37:07.908082 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.907909    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 21:37:07.908289 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.908275    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 21:37:07.922452 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.922426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:07.970439 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.970410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:07.970619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.970490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zv7\" (UniqueName: \"kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:07.970619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.970530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:07.970619 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:07.970549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.071650 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.071609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zv7\" (UniqueName: \"kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.071826 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.071669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.071871 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.071826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.071916 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.071875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.072376 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.072357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.074308 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.074285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.074434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.074413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.086828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.086804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zv7\" (UniqueName: \"kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7\") pod \"maas-api-7fd99f4487-zw982\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") " pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.213897 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.213859    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:08.485395 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.485229    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:08.488140 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:37:08.488108    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5f7f9d_8267_4786_ae0f_e4431a2499e9.slice/crio-de20d250d5597c166c85f29c63d5dce6086ec4f191c65ddde8cd7bb632782fe2 WatchSource:0}: Error finding container de20d250d5597c166c85f29c63d5dce6086ec4f191c65ddde8cd7bb632782fe2: Status 404 returned error can't find the container with id de20d250d5597c166c85f29c63d5dce6086ec4f191c65ddde8cd7bb632782fe2
Sep 07 21:37:08.489504 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:08.489487    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:37:09.145211 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:09.145177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" event={"ID":"2e5f7f9d-8267-4786-ae0f-e4431a2499e9","Type":"ContainerStarted","Data":"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"}
Sep 07 21:37:09.145614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:09.145227    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" event={"ID":"2e5f7f9d-8267-4786-ae0f-e4431a2499e9","Type":"ContainerStarted","Data":"de20d250d5597c166c85f29c63d5dce6086ec4f191c65ddde8cd7bb632782fe2"}
Sep 07 21:37:09.145614 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:09.145281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:09.162539 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:09.162488    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" podStartSLOduration=1.751905448 podStartE2EDuration="2.162471107s" totalImagesPullingTime="410.565659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:37:09.161154991 +0000 UTC m=+2140.997281098" watchObservedRunningTime="2026-09-07 21:37:09.162471107 +0000 UTC m=+2140.998597215"
Sep 07 21:37:12.242232 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:12.242196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:37:15.156780 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.156747    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:15.249663 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.249631    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"]
Sep 07 21:37:15.253347 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.253329    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.263225 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.263197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"]
Sep 07 21:37:15.340004 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.339921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-metrics-certs\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.340175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.340006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2160270-61db-4dee-b1ba-dba534902850-openshift-service-ca\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.340175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.340039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzhg\" (UniqueName: \"kubernetes.io/projected/a2160270-61db-4dee-b1ba-dba534902850-kube-api-access-2hzhg\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.340175 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.340141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-maas-api-tls\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.441346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.441259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-maas-api-tls\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.441346 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.441303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-metrics-certs\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.441535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.441348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2160270-61db-4dee-b1ba-dba534902850-openshift-service-ca\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.441535 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.441384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzhg\" (UniqueName: \"kubernetes.io/projected/a2160270-61db-4dee-b1ba-dba534902850-kube-api-access-2hzhg\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.442114 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.442086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2160270-61db-4dee-b1ba-dba534902850-openshift-service-ca\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.443990 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.443931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-metrics-certs\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.444082 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.443934    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2160270-61db-4dee-b1ba-dba534902850-maas-api-tls\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.449731 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.449707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzhg\" (UniqueName: \"kubernetes.io/projected/a2160270-61db-4dee-b1ba-dba534902850-kube-api-access-2hzhg\") pod \"maas-api-7844d4b579-kb7rk\" (UID: \"a2160270-61db-4dee-b1ba-dba534902850\") " pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.565414 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.565376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:15.837065 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:15.837039    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"]
Sep 07 21:37:15.839323 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:37:15.839283    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2160270_61db_4dee_b1ba_dba534902850.slice/crio-c6555a08bfdda5211a8dee960673319d38ca1c882c7e3580cf1e128cbc291fea WatchSource:0}: Error finding container c6555a08bfdda5211a8dee960673319d38ca1c882c7e3580cf1e128cbc291fea: Status 404 returned error can't find the container with id c6555a08bfdda5211a8dee960673319d38ca1c882c7e3580cf1e128cbc291fea
Sep 07 21:37:16.187996 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:16.187968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk" event={"ID":"a2160270-61db-4dee-b1ba-dba534902850","Type":"ContainerStarted","Data":"c6555a08bfdda5211a8dee960673319d38ca1c882c7e3580cf1e128cbc291fea"}
Sep 07 21:37:17.195378 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:17.195331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk" event={"ID":"a2160270-61db-4dee-b1ba-dba534902850","Type":"ContainerStarted","Data":"0316b77ca8e1ef61661f6a3b41a074c123176031a250c810ffd882d6766e34c5"}
Sep 07 21:37:17.195844 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:17.195404    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:17.214191 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:17.214132    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk" podStartSLOduration=1.914126541 podStartE2EDuration="2.21411757s" totalImagesPullingTime="299.991029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:37:17.211837264 +0000 UTC m=+2149.047963381" watchObservedRunningTime="2026-09-07 21:37:17.21411757 +0000 UTC m=+2149.050243674"
Sep 07 21:37:23.206010 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.205918    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7844d4b579-kb7rk"
Sep 07 21:37:23.251852 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.251816    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:23.252174 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.252107    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" podUID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" containerName="maas-api" containerID="cri-o://ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc" gracePeriod=30
Sep 07 21:37:23.504325 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.504293    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:23.619621 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.619586    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8zv7\" (UniqueName: \"kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7\") pod \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") "
Sep 07 21:37:23.619621 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.619635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca\") pod \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") "
Sep 07 21:37:23.619850 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.619668    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls\") pod \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") "
Sep 07 21:37:23.619850 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.619825    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs\") pod \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\" (UID: \"2e5f7f9d-8267-4786-ae0f-e4431a2499e9\") "
Sep 07 21:37:23.620074 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.620045    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e5f7f9d-8267-4786-ae0f-e4431a2499e9" (UID: "2e5f7f9d-8267-4786-ae0f-e4431a2499e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:37:23.620212 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.620201    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-openshift-service-ca\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:37:23.621765 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.621729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2e5f7f9d-8267-4786-ae0f-e4431a2499e9" (UID: "2e5f7f9d-8267-4786-ae0f-e4431a2499e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:37:23.621877 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.621773    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e5f7f9d-8267-4786-ae0f-e4431a2499e9" (UID: "2e5f7f9d-8267-4786-ae0f-e4431a2499e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:37:23.621968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.621884    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7" (OuterVolumeSpecName: "kube-api-access-c8zv7") pod "2e5f7f9d-8267-4786-ae0f-e4431a2499e9" (UID: "2e5f7f9d-8267-4786-ae0f-e4431a2499e9"). InnerVolumeSpecName "kube-api-access-c8zv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:37:23.721498 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.721450    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8zv7\" (UniqueName: \"kubernetes.io/projected/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-kube-api-access-c8zv7\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:37:23.721498 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.721489    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-maas-api-tls\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:37:23.721498 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:23.721498    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e5f7f9d-8267-4786-ae0f-e4431a2499e9-metrics-certs\") on node \"ip-10-0-136-145.ec2.internal\" DevicePath \"\""
Sep 07 21:37:24.239555 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.239516    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" containerID="ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc" exitCode=0
Sep 07 21:37:24.239989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.239568    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"
Sep 07 21:37:24.239989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.239606    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" event={"ID":"2e5f7f9d-8267-4786-ae0f-e4431a2499e9","Type":"ContainerDied","Data":"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"}
Sep 07 21:37:24.239989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.239662    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fd99f4487-zw982" event={"ID":"2e5f7f9d-8267-4786-ae0f-e4431a2499e9","Type":"ContainerDied","Data":"de20d250d5597c166c85f29c63d5dce6086ec4f191c65ddde8cd7bb632782fe2"}
Sep 07 21:37:24.239989 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.239685    2583 scope.go:117] "RemoveContainer" containerID="ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"
Sep 07 21:37:24.251188 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.251156    2583 scope.go:117] "RemoveContainer" containerID="ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"
Sep 07 21:37:24.251515 ip-10-0-136-145 kubenswrapper[2583]: E0907 21:37:24.251494    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc\": container with ID starting with ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc not found: ID does not exist" containerID="ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"
Sep 07 21:37:24.251590 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.251524    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc"} err="failed to get container status \"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc\": rpc error: code = NotFound desc = could not find container \"ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc\": container with ID starting with ea6c943c8be9ddcc94cdc9336da9dedd8971bb2b2d80e8c7e49f2f0dc65bbbdc not found: ID does not exist"
Sep 07 21:37:24.265673 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.265623    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:24.270199 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.270163    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fd99f4487-zw982"]
Sep 07 21:37:24.677505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:24.677470    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" path="/var/lib/kubelet/pods/2e5f7f9d-8267-4786-ae0f-e4431a2499e9/volumes"
Sep 07 21:37:48.020332 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:48.020276    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f42kr_5faa93de-ba3b-4605-a306-748d1bee4d45/manager/0.log"
Sep 07 21:37:48.136408 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:48.136378    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tsnff_f7879f2f-f9c9-47b1-821f-9968b62e90c3/manager/0.log"
Sep 07 21:37:48.848425 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:48.848394    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-w47f6_e86cc64b-715e-40bd-940e-3a20bbb87be3/copy-manifests/0.log"
Sep 07 21:37:48.860169 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:48.860141    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-w47f6_e86cc64b-715e-40bd-940e-3a20bbb87be3/manager/0.log"
Sep 07 21:37:49.198747 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:49.198720    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7844d4b579-kb7rk_a2160270-61db-4dee-b1ba-dba534902850/maas-api/0.log"
Sep 07 21:37:49.416842 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:49.416809    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813595-z49b8_292a096e-69c5-4e88-9887-b03f035f1334/cleanup/0.log"
Sep 07 21:37:50.846885 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:50.846854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-kx8pd_1ccbc9f6-cd00-446a-884f-799962b922d6/manager/0.log"
Sep 07 21:37:51.084401 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:51.084372    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-kffsf_cc7aa14a-a723-4db9-b897-d91a744969e5/manager/0.log"
Sep 07 21:37:52.090584 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:52.090542    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:37:52.645407 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:52.645372    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r2wv9_4b021339-6891-4b78-987b-6521a5f1516d/main/0.log"
Sep 07 21:37:53.093591 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:53.093550    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2wfg6_f6896a76-0334-4b67-9d84-a23d57a31e70/main/0.log"
Sep 07 21:37:59.049505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:59.049460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:37:59.144298 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:37:59.144266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log" limit=1024
Sep 07 21:38:01.991312 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:01.991286    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rhzxb_b7d8d215-3588-47cf-bb08-70e0c12ccf40/global-pull-secret-syncer/0.log"
Sep 07 21:38:02.038686 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:02.038656    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bs5sp_e83580d1-438d-48f3-95c8-342c7b85eeda/konnectivity-agent/0.log"
Sep 07 21:38:02.151287 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:02.151259    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-145.ec2.internal_0135ba7d47a7fd3cfb345c16777546ed/haproxy/0.log"
Sep 07 21:38:06.654560 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:06.654526    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-kx8pd_1ccbc9f6-cd00-446a-884f-799962b922d6/manager/0.log"
Sep 07 21:38:06.756210 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:06.756082    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-kffsf_cc7aa14a-a723-4db9-b897-d91a744969e5/manager/0.log"
Sep 07 21:38:08.218261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.218183    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/alertmanager/0.log"
Sep 07 21:38:08.240313 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.240287    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/config-reloader/0.log"
Sep 07 21:38:08.261381 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.261355    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/kube-rbac-proxy-web/0.log"
Sep 07 21:38:08.281768 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.281747    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/kube-rbac-proxy/0.log"
Sep 07 21:38:08.302403 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.302381    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/kube-rbac-proxy-metric/0.log"
Sep 07 21:38:08.326098 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.326060    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/prom-label-proxy/0.log"
Sep 07 21:38:08.360287 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.360258    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e4e83404-85c7-4102-ac8d-bef7efcfb661/init-config-reloader/0.log"
Sep 07 21:38:08.546514 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.546475    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-c7k46_433f69df-2e41-4a62-b616-ad2e06d39611/monitoring-plugin/0.log"
Sep 07 21:38:08.576161 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.576135    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rtxg_c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e/node-exporter/0.log"
Sep 07 21:38:08.597707 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.597677    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rtxg_c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e/kube-rbac-proxy/0.log"
Sep 07 21:38:08.619434 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.619416    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rtxg_c9a080d2-1e9e-4e95-a0b4-ec48a9682f5e/init-textfile/0.log"
Sep 07 21:38:08.817079 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.817052    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s5ksg_3984b518-53ed-4cae-b62a-59b7707ee4c2/kube-rbac-proxy-main/0.log"
Sep 07 21:38:08.839261 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.839228    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s5ksg_3984b518-53ed-4cae-b62a-59b7707ee4c2/kube-rbac-proxy-self/0.log"
Sep 07 21:38:08.861777 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.861725    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-s5ksg_3984b518-53ed-4cae-b62a-59b7707ee4c2/openshift-state-metrics/0.log"
Sep 07 21:38:08.899997 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.899971    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/prometheus/0.log"
Sep 07 21:38:08.919785 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.919754    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/config-reloader/0.log"
Sep 07 21:38:08.943483 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.943461    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/thanos-sidecar/0.log"
Sep 07 21:38:08.963676 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.963659    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/kube-rbac-proxy-web/0.log"
Sep 07 21:38:08.983635 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:08.983614    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/kube-rbac-proxy/0.log"
Sep 07 21:38:09.006209 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.006184    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/kube-rbac-proxy-thanos/0.log"
Sep 07 21:38:09.028507 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.028482    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fceaf9e9-7b9a-419c-8ebf-a21547270a09/init-config-reloader/0.log"
Sep 07 21:38:09.120283 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.120210    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-ltc6p_6b2503f3-4532-4231-9f99-995720104b09/prometheus-operator-admission-webhook/0.log"
Sep 07 21:38:09.154507 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.154480    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f8f67cd-87jd9_90b9ced7-cdfb-4739-adcf-7c527a932863/telemeter-client/0.log"
Sep 07 21:38:09.177351 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.177321    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f8f67cd-87jd9_90b9ced7-cdfb-4739-adcf-7c527a932863/reload/0.log"
Sep 07 21:38:09.196469 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:09.196446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68f8f67cd-87jd9_90b9ced7-cdfb-4739-adcf-7c527a932863/kube-rbac-proxy/0.log"
Sep 07 21:38:12.118858 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.118820    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"]
Sep 07 21:38:12.119321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.119224    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" containerName="maas-api"
Sep 07 21:38:12.119321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.119238    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" containerName="maas-api"
Sep 07 21:38:12.119321 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.119314    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5f7f9d-8267-4786-ae0f-e4431a2499e9" containerName="maas-api"
Sep 07 21:38:12.122484 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.122464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.124968 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.124925    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z6sq6\"/\"default-dockercfg-6fhnj\""
Sep 07 21:38:12.125125 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.125108    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6sq6\"/\"openshift-service-ca.crt\""
Sep 07 21:38:12.125697 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.125678    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6sq6\"/\"kube-root-ca.crt\""
Sep 07 21:38:12.131345 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.131322    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"]
Sep 07 21:38:12.152604 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.152583    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-548d74cdf5-lw9hk_b83a0c55-4391-4c4a-8824-d43ef673810a/console/0.log"
Sep 07 21:38:12.184375 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.184330    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-76lzs_b8eb7844-e908-4fc0-b5a0-505726caad1b/download-server/0.log"
Sep 07 21:38:12.256367 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.256332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-sys\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.256541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.256372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-lib-modules\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.256541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.256396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-proc\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.256541 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.256520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7j5\" (UniqueName: \"kubernetes.io/projected/784f5638-b07f-4c9b-bcf7-6d4fc019512c-kube-api-access-xf7j5\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.256672 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.256567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-podres\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-sys\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-lib-modules\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-proc\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7j5\" (UniqueName: \"kubernetes.io/projected/784f5638-b07f-4c9b-bcf7-6d4fc019512c-kube-api-access-xf7j5\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357758    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-sys\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-podres\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-lib-modules\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-proc\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.357900 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.357839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784f5638-b07f-4c9b-bcf7-6d4fc019512c-podres\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.366438 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.366416    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7j5\" (UniqueName: \"kubernetes.io/projected/784f5638-b07f-4c9b-bcf7-6d4fc019512c-kube-api-access-xf7j5\") pod \"perf-node-gather-daemonset-fxdn5\" (UID: \"784f5638-b07f-4c9b-bcf7-6d4fc019512c\") " pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.434251 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.434223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:12.709113 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:12.709088    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"]
Sep 07 21:38:12.711155 ip-10-0-136-145 kubenswrapper[2583]: W0907 21:38:12.711128    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod784f5638_b07f_4c9b_bcf7_6d4fc019512c.slice/crio-113bb9a139f7072cefbb0c269dd4116ae8658a7d9931ceeae76c7ae7b9b95031 WatchSource:0}: Error finding container 113bb9a139f7072cefbb0c269dd4116ae8658a7d9931ceeae76c7ae7b9b95031: Status 404 returned error can't find the container with id 113bb9a139f7072cefbb0c269dd4116ae8658a7d9931ceeae76c7ae7b9b95031
Sep 07 21:38:13.497014 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:13.496976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5" event={"ID":"784f5638-b07f-4c9b-bcf7-6d4fc019512c","Type":"ContainerStarted","Data":"1efaa3f7ae3799d568f6d41c33082deb6affe3ea659f2bf3989550cb8b6f98a1"}
Sep 07 21:38:13.497406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:13.497030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5" event={"ID":"784f5638-b07f-4c9b-bcf7-6d4fc019512c","Type":"ContainerStarted","Data":"113bb9a139f7072cefbb0c269dd4116ae8658a7d9931ceeae76c7ae7b9b95031"}
Sep 07 21:38:13.497406 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:13.497062    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:13.513828 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:13.513781    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5" podStartSLOduration=1.513767478 podStartE2EDuration="1.513767478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:38:13.512103374 +0000 UTC m=+2205.348229478" watchObservedRunningTime="2026-09-07 21:38:13.513767478 +0000 UTC m=+2205.349893583"
Sep 07 21:38:14.041505 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:14.041476    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf2p8_5dcd1cd7-18be-403b-97e4-0ed075627055/dns/0.log"
Sep 07 21:38:14.063710 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:14.063682    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf2p8_5dcd1cd7-18be-403b-97e4-0ed075627055/kube-rbac-proxy/0.log"
Sep 07 21:38:14.231076 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:14.231045    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wjvl5_26b804cf-cddc-43ef-9758-86844dd929b2/dns-node-resolver/0.log"
Sep 07 21:38:14.792816 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:14.792787    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8xlvw_9b8b8d20-ae1f-4ad6-9ee9-2f73d351e0a6/node-ca/0.log"
Sep 07 21:38:16.191852 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:16.191822    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:38:17.097657 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:17.097623    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-swbg5_ca295cf6-a5a2-4f3d-935b-e7ce38b8d65a/serve-healthcheck-canary/0.log"
Sep 07 21:38:17.726769 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:17.726706    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5vcp_9a3e92a7-a14d-454c-ae94-7faa7e3182d8/kube-rbac-proxy/0.log"
Sep 07 21:38:17.746775 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:17.746752    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5vcp_9a3e92a7-a14d-454c-ae94-7faa7e3182d8/exporter/0.log"
Sep 07 21:38:17.767874 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:17.767850    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k5vcp_9a3e92a7-a14d-454c-ae94-7faa7e3182d8/extractor/0.log"
Sep 07 21:38:19.512350 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:19.512316    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z6sq6/perf-node-gather-daemonset-fxdn5"
Sep 07 21:38:19.852467 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:19.852368    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f42kr_5faa93de-ba3b-4605-a306-748d1bee4d45/manager/0.log"
Sep 07 21:38:20.017659 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:20.017622    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tsnff_f7879f2f-f9c9-47b1-821f-9968b62e90c3/manager/0.log"
Sep 07 21:38:20.345375 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:20.345340    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-w47f6_e86cc64b-715e-40bd-940e-3a20bbb87be3/manager/0.log"
Sep 07 21:38:20.362821 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:20.362794    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56489b9975-w47f6_e86cc64b-715e-40bd-940e-3a20bbb87be3/copy-manifests/0.log"
Sep 07 21:38:21.741793 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:21.741766    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75546db857-8j2rw_abe26247-0396-4820-9b15-6eff1b0e3735/manager/0.log"
Sep 07 21:38:21.803727 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:21.803697    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wkfmm_8502c205-1151-44b8-be90-bd1c6eced6c8/openshift-lws-operator/0.log"
Sep 07 21:38:22.907153 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:22.907126    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:38:24.891879 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:24.891850    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gvzs6_4792b5c5-a185-4041-950a-da4b5beb40ec/payload-processing/0.log"
Sep 07 21:38:26.956599 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:26.956571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-rntxj_fb76871d-8a5a-4223-aaab-6501ae381e19/migrator/0.log"
Sep 07 21:38:26.996019 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:26.995990    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-rntxj_fb76871d-8a5a-4223-aaab-6501ae381e19/graceful-termination/0.log"
Sep 07 21:38:27.350177 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:27.350078    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-plvwf_a35adee1-d31e-4c91-827c-ac35c96d542d/kube-storage-version-migrator-operator/1.log"
Sep 07 21:38:27.350869 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:27.350847    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-plvwf_a35adee1-d31e-4c91-827c-ac35c96d542d/kube-storage-version-migrator-operator/0.log"
Sep 07 21:38:28.528200 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.528115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/kube-multus-additional-cni-plugins/0.log"
Sep 07 21:38:28.548838 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.548791    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/egress-router-binary-copy/0.log"
Sep 07 21:38:28.568880 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.568862    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/cni-plugins/0.log"
Sep 07 21:38:28.589012 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.588986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/bond-cni-plugin/0.log"
Sep 07 21:38:28.609555 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.609535    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/routeoverride-cni/0.log"
Sep 07 21:38:28.628847 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.628829    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/whereabouts-cni-bincopy/0.log"
Sep 07 21:38:28.648168 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.648151    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-glm7g_5050c00c-189d-4d45-97c3-54a86ae5a3be/whereabouts-cni/0.log"
Sep 07 21:38:28.890532 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.890466    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lphrm_c0ad9aa7-71f3-488b-a521-94ec9082c051/kube-multus/0.log"
Sep 07 21:38:28.955880 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.955846    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8xdwm_b7700639-a809-449f-b7d6-38b6d2872fc7/network-metrics-daemon/0.log"
Sep 07 21:38:28.974084 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:28.974049    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8xdwm_b7700639-a809-449f-b7d6-38b6d2872fc7/kube-rbac-proxy/0.log"
Sep 07 21:38:29.045037 ip-10-0-136-145 kubenswrapper[2583]: I0907 21:38:29.045004    2583 scope.go:117] "RemoveContainer" containerID="9083a08c5766ca558520fc95967e3d61d389356aa07a7399c23a02193d27ba6f"